python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1196617 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3512841'] with mtr_portfolio_ids : ['25915175'] and first list_photo_ids : [] new path : /proc/1196617/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 2.984811305999756 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 12 16:00:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10735 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-12 16:00:35.925436: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-12 16:00:35.951593: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-12 16:00:35.953746: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff664000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-12 16:00:35.953803: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-12 16:00:35.957697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-12 16:00:36.101903: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xba880e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-12 16:00:36.101946: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-12 16:00:36.103080: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 16:00:36.103432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 16:00:36.105862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 16:00:36.108345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 16:00:36.108729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 16:00:36.137112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 16:00:36.138497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 16:00:36.143116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 16:00:36.144655: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 16:00:36.144739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 16:00:36.145527: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 16:00:36.145543: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 16:00:36.145552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 16:00:36.146942: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9947 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-12 16:00:36.413057: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 16:00:36.413143: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 16:00:36.413164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 16:00:36.413182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 16:00:36.413200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 16:00:36.413218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 16:00:36.413236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 16:00:36.413254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 16:00:36.414839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 16:00:36.416253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 16:00:36.416307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 16:00:36.416327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 16:00:36.416345: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 16:00:36.416362: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 16:00:36.416379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 16:00:36.416396: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 16:00:36.416413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 16:00:36.417990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 16:00:36.418021: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 16:00:36.418032: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 16:00:36.418042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 16:00:36.419727: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9947 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-12 16:00:44.921686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 16:00:45.082150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 54.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1197210 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1667 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6956 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006110668182373047 nb_pixel_total : 28188 time to create 1 rle with old method : 0.03224492073059082 length of segment : 150 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 6068 time to create 1 rle with old method : 0.0071718692779541016 length of segment : 110 time for calcul the mask position with numpy : 0.010467052459716797 nb_pixel_total : 651224 time to create 1 rle with new method : 0.043387413024902344 length of segment : 1096 time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 12989 time to create 1 rle with old method : 0.014598846435546875 length of segment : 155 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 13306 time to create 1 rle with old method : 0.015442609786987305 length of segment : 172 time for calcul the mask position with numpy : 0.00038552284240722656 nb_pixel_total : 24673 time to create 1 rle with old method : 0.028008222579956055 length of segment : 142 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 8901 time to create 1 rle with old method : 0.010344266891479492 length of segment : 159 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 10607 time to create 1 rle with old method : 0.01261138916015625 length of segment : 125 time for calcul the mask position with numpy : 0.0017688274383544922 nb_pixel_total : 115859 time to create 1 rle with old method : 0.132110595703125 length of segment : 557 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 11613 time to create 1 rle with old method : 0.013705730438232422 length of segment : 185 time for calcul the mask position with numpy : 0.00040912628173828125 nb_pixel_total : 21656 time to create 1 rle with old method : 0.024641752243041992 length of segment : 286 time for calcul the mask position with numpy : 0.00017404556274414062 nb_pixel_total : 6239 time to create 1 rle with old method : 0.007577180862426758 length of segment : 88 time for calcul the mask position with numpy : 0.00030612945556640625 nb_pixel_total : 20851 time to create 1 rle with old method : 0.02413344383239746 length of segment : 158 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 11240 time to create 1 rle with old method : 0.013055562973022461 length of segment : 136 time for calcul the mask position with numpy : 0.0016481876373291016 nb_pixel_total : 107362 time to create 1 rle with old method : 0.12060832977294922 length of segment : 559 time for calcul the mask position with numpy : 0.0002613067626953125 nb_pixel_total : 11821 time to create 1 rle with old method : 0.013845205307006836 length of segment : 185 time for calcul the mask position with numpy : 0.0015749931335449219 nb_pixel_total : 113202 time to create 1 rle with old method : 0.1288011074066162 length of segment : 553 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 14763 time to create 1 rle with old method : 0.017023086547851562 length of segment : 154 time for calcul the mask position with numpy : 0.0001862049102783203 nb_pixel_total : 11275 time to create 1 rle with old method : 0.0133056640625 length of segment : 130 time for calcul the mask position with numpy : 0.00019979476928710938 nb_pixel_total : 12528 time to create 1 rle with old method : 0.014569282531738281 length of segment : 120 time for calcul the mask position with numpy : 0.00013899803161621094 nb_pixel_total : 5800 time to create 1 rle with old method : 0.007050752639770508 length of segment : 92 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 9576 time to create 1 rle with old method : 0.011016607284545898 length of segment : 131 time for calcul the mask position with numpy : 0.011203527450561523 nb_pixel_total : 917824 time to create 1 rle with new method : 0.06735920906066895 length of segment : 1348 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 5576 time to create 1 rle with old method : 0.006571292877197266 length of segment : 105 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 29254 time to create 1 rle with old method : 0.03304767608642578 length of segment : 242 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 4866 time to create 1 rle with old method : 0.005962848663330078 length of segment : 150 time for calcul the mask position with numpy : 0.002652406692504883 nb_pixel_total : 95565 time to create 1 rle with old method : 0.10552096366882324 length of segment : 527 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 24905 time to create 1 rle with old method : 0.028711557388305664 length of segment : 154 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 4588 time to create 1 rle with old method : 0.0056514739990234375 length of segment : 86 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 10705 time to create 1 rle with old method : 0.012312889099121094 length of segment : 175 time for calcul the mask position with numpy : 0.0005443096160888672 nb_pixel_total : 36868 time to create 1 rle with old method : 0.042260169982910156 length of segment : 191 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 1846 time to create 1 rle with old method : 0.002279996871948242 length of segment : 57 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 11054 time to create 1 rle with old method : 0.013551712036132812 length of segment : 157 time for calcul the mask position with numpy : 0.0025930404663085938 nb_pixel_total : 100515 time to create 1 rle with old method : 0.11253023147583008 length of segment : 543 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 35789 time to create 1 rle with old method : 0.04735565185546875 length of segment : 145 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 8249 time to create 1 rle with old method : 0.009789705276489258 length of segment : 145 time for calcul the mask position with numpy : 0.012329816818237305 nb_pixel_total : 555985 time to create 1 rle with new method : 0.020493745803833008 length of segment : 1706 time for calcul the mask position with numpy : 0.010569334030151367 nb_pixel_total : 688392 time to create 1 rle with new method : 0.0193941593170166 length of segment : 1117 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 10694 time to create 1 rle with old method : 0.01245260238647461 length of segment : 89 time for calcul the mask position with numpy : 0.011898517608642578 nb_pixel_total : 721288 time to create 1 rle with new method : 0.027552127838134766 length of segment : 1121 time for calcul the mask position with numpy : 0.00020051002502441406 nb_pixel_total : 5166 time to create 1 rle with old method : 0.005950212478637695 length of segment : 73 time for calcul the mask position with numpy : 0.0003008842468261719 nb_pixel_total : 5993 time to create 1 rle with old method : 0.0066967010498046875 length of segment : 158 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 40310 time to create 1 rle with old method : 0.045090675354003906 length of segment : 164 time for calcul the mask position with numpy : 0.0002048015594482422 nb_pixel_total : 5973 time to create 1 rle with old method : 0.006838083267211914 length of segment : 127 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 11755 time to create 1 rle with old method : 0.01334691047668457 length of segment : 145 time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 8964 time to create 1 rle with old method : 0.010332822799682617 length of segment : 136 time for calcul the mask position with numpy : 0.013737201690673828 nb_pixel_total : 925716 time to create 1 rle with new method : 0.02032756805419922 length of segment : 1582 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 20555 time to create 1 rle with old method : 0.0224151611328125 length of segment : 165 time for calcul the mask position with numpy : 0.0021317005157470703 nb_pixel_total : 82970 time to create 1 rle with old method : 0.09188199043273926 length of segment : 382 time for calcul the mask position with numpy : 0.00013566017150878906 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0021860599517822266 length of segment : 41 time for calcul the mask position with numpy : 0.0015904903411865234 nb_pixel_total : 98951 time to create 1 rle with old method : 0.11045193672180176 length of segment : 631 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 7602 time to create 1 rle with old method : 0.009107828140258789 length of segment : 107 time for calcul the mask position with numpy : 0.0018603801727294922 nb_pixel_total : 98353 time to create 1 rle with old method : 0.10921216011047363 length of segment : 548 time for calcul the mask position with numpy : 0.0004012584686279297 nb_pixel_total : 5074 time to create 1 rle with old method : 0.007938385009765625 length of segment : 186 time for calcul the mask position with numpy : 0.002546072006225586 nb_pixel_total : 125626 time to create 1 rle with old method : 0.14394307136535645 length of segment : 562 time for calcul the mask position with numpy : 0.0005447864532470703 nb_pixel_total : 26442 time to create 1 rle with old method : 0.030190467834472656 length of segment : 188 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 11618 time to create 1 rle with old method : 0.013748407363891602 length of segment : 135 time for calcul the mask position with numpy : 0.00019073486328125 nb_pixel_total : 2899 time to create 1 rle with old method : 0.00347137451171875 length of segment : 78 time for calcul the mask position with numpy : 0.00012063980102539062 nb_pixel_total : 2154 time to create 1 rle with old method : 0.002728700637817383 length of segment : 48 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 2594 time to create 1 rle with old method : 0.0032973289489746094 length of segment : 62 time for calcul the mask position with numpy : 0.016436338424682617 nb_pixel_total : 753241 time to create 1 rle with new method : 0.02345442771911621 length of segment : 929 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 2993 time to create 1 rle with old method : 0.003748655319213867 length of segment : 85 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 9911 time to create 1 rle with old method : 0.011582374572753906 length of segment : 135 time for calcul the mask position with numpy : 0.0009853839874267578 nb_pixel_total : 42876 time to create 1 rle with old method : 0.04889082908630371 length of segment : 192 time for calcul the mask position with numpy : 0.0028769969940185547 nb_pixel_total : 127213 time to create 1 rle with old method : 0.14314031600952148 length of segment : 578 time for calcul the mask position with numpy : 0.014940977096557617 nb_pixel_total : 729035 time to create 1 rle with new method : 0.020494461059570312 length of segment : 944 time for calcul the mask position with numpy : 0.0005476474761962891 nb_pixel_total : 10225 time to create 1 rle with old method : 0.011672019958496094 length of segment : 173 time for calcul the mask position with numpy : 0.0005633831024169922 nb_pixel_total : 18100 time to create 1 rle with old method : 0.02072906494140625 length of segment : 148 time for calcul the mask position with numpy : 0.0006363391876220703 nb_pixel_total : 27297 time to create 1 rle with old method : 0.030667543411254883 length of segment : 235 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 14743 time to create 1 rle with old method : 0.016373395919799805 length of segment : 204 time for calcul the mask position with numpy : 0.0029060840606689453 nb_pixel_total : 104727 time to create 1 rle with old method : 0.11404705047607422 length of segment : 591 time spent for convertir_results : 5.828803300857544 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 71 chid ids of type : 3594 Number RLEs to save : 23233 save missing photos in datou_result : time spend for datou_step_exec : 35.30328178405762 time spend to save output : 1.263929843902588 total time spend for step 1 : 36.567211627960205 step2:crop_condition Tue Aug 12 16:01:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 71 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755007271_1196617 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.968042373657227 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755007278_1196617 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0867221355438232 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755007309_1196617 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.584271430969238 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755007323_1196617 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1388580799102783 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1376599551, 1376599550, 1376599548, 1376599545, 1376599533, 1376599510, 1376599503, 1376599470, 1376599466, 1376599463, 1376599462, 1376599459, 1376599451, 1376599444, 1376599441, 1376599439, 1376599437, 1376599429, 1376599426, 1376599421, 1376599419, 1376599418, 1376599416, 1376599388] Looping around the photos to save general results len do output : 71 /1376631529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376631982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376632021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376632022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376632024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599551', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599550', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599548', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599545', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599533', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599510', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599503', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599470', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599466', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599463', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599462', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599459', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599451', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599444', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599441', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599439', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599437', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599429', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599426', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599421', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599419', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599418', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599416', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599388', None, None, None, None, None, '3512841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 237 time used for this insertion : 0.02411627769470215 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.16442012786865 time spend to save output : 0.027281522750854492 total time spend for step 2 : 55.19170165061951 step3:rle_unique_nms_with_priority Tue Aug 12 16:02:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 71 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.5227053165435791 time for calcul the mask position with numpy : 0.21871113777160645 nb_pixel_total : 1388120 time to create 1 rle with new method : 0.18773698806762695 time for calcul the mask position with numpy : 0.012436389923095703 nb_pixel_total : 651224 time to create 1 rle with new method : 0.10364198684692383 time for calcul the mask position with numpy : 0.006197214126586914 nb_pixel_total : 6068 time to create 1 rle with old method : 0.006794452667236328 time for calcul the mask position with numpy : 0.0065310001373291016 nb_pixel_total : 28188 time to create 1 rle with old method : 0.03083491325378418 create new chi : 0.5890424251556396 time to delete rle : 0.024929046630859375 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 3792 TO DO : save crop sub photo not yet done ! save time : 0.2442009449005127 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.2079172134399414 time for calcul the mask position with numpy : 0.08636593818664551 nb_pixel_total : 2060611 time to create 1 rle with new method : 0.1159067153930664 time for calcul the mask position with numpy : 0.0065610408782958984 nb_pixel_total : 12989 time to create 1 rle with old method : 0.01475381851196289 create new chi : 0.22916150093078613 time to delete rle : 0.000244140625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1390 TO DO : save crop sub photo not yet done ! save time : 0.11968088150024414 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.22060370445251465 time for calcul the mask position with numpy : 0.2580859661102295 nb_pixel_total : 1897040 time to create 1 rle with new method : 0.2146286964416504 time for calcul the mask position with numpy : 0.006588935852050781 nb_pixel_total : 3214 time to create 1 rle with old method : 0.003679990768432617 time for calcul the mask position with numpy : 0.008374929428100586 nb_pixel_total : 115859 time to create 1 rle with old method : 0.12851667404174805 time for calcul the mask position with numpy : 0.006173133850097656 nb_pixel_total : 10607 time to create 1 rle with old method : 0.011903762817382812 time for calcul the mask position with numpy : 0.0066986083984375 nb_pixel_total : 8901 time to create 1 rle with old method : 0.009999990463256836 time for calcul the mask position with numpy : 0.006770610809326172 nb_pixel_total : 24673 time to create 1 rle with old method : 0.027515888214111328 time for calcul the mask position with numpy : 0.00960993766784668 nb_pixel_total : 13306 time to create 1 rle with old method : 0.01490163803100586 create new chi : 0.7256567478179932 time to delete rle : 0.0005743503570556641 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3603 TO DO : save crop sub photo not yet done ! save time : 0.23421645164489746 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07212686538696289 time for calcul the mask position with numpy : 0.7648212909698486 nb_pixel_total : 1906252 time to create 1 rle with new method : 0.6360538005828857 time for calcul the mask position with numpy : 0.00845789909362793 nb_pixel_total : 107362 time to create 1 rle with old method : 0.12145209312438965 time for calcul the mask position with numpy : 0.007885217666625977 nb_pixel_total : 11240 time to create 1 rle with old method : 0.013624906539916992 time for calcul the mask position with numpy : 0.008315563201904297 nb_pixel_total : 20851 time to create 1 rle with old method : 0.02529001235961914 time for calcul the mask position with numpy : 0.0071985721588134766 nb_pixel_total : 6239 time to create 1 rle with old method : 0.007541179656982422 time for calcul the mask position with numpy : 0.006886005401611328 nb_pixel_total : 21656 time to create 1 rle with old method : 0.025403976440429688 create new chi : 1.6477007865905762 time to delete rle : 0.0005478858947753906 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3534 TO DO : save crop sub photo not yet done ! save time : 0.2378406524658203 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06634092330932617 time for calcul the mask position with numpy : 0.021219491958618164 nb_pixel_total : 1922539 time to create 1 rle with new method : 0.12253260612487793 time for calcul the mask position with numpy : 0.0064013004302978516 nb_pixel_total : 11275 time to create 1 rle with old method : 0.012327432632446289 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 14763 time to create 1 rle with old method : 0.016797542572021484 time for calcul the mask position with numpy : 0.007023334503173828 nb_pixel_total : 113202 time to create 1 rle with old method : 0.12530064582824707 time for calcul the mask position with numpy : 0.006108522415161133 nb_pixel_total : 11821 time to create 1 rle with old method : 0.012996196746826172 create new chi : 0.34545278549194336 time to delete rle : 0.0005078315734863281 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3124 TO DO : save crop sub photo not yet done ! save time : 0.21364116668701172 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.5996050834655762 time for calcul the mask position with numpy : 0.27921438217163086 nb_pixel_total : 2045696 time to create 1 rle with new method : 0.22830629348754883 time for calcul the mask position with numpy : 0.006418704986572266 nb_pixel_total : 9576 time to create 1 rle with old method : 0.01031637191772461 time for calcul the mask position with numpy : 0.006584882736206055 nb_pixel_total : 5800 time to create 1 rle with old method : 0.006301403045654297 time for calcul the mask position with numpy : 0.006487846374511719 nb_pixel_total : 12528 time to create 1 rle with old method : 0.013708353042602539 create new chi : 0.5671541690826416 time to delete rle : 0.0003223419189453125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1766 TO DO : save crop sub photo not yet done ! save time : 0.1728198528289795 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.039010047912597656 time for calcul the mask position with numpy : 0.01439976692199707 nb_pixel_total : 1155776 time to create 1 rle with new method : 0.1184227466583252 time for calcul the mask position with numpy : 0.012869834899902344 nb_pixel_total : 917824 time to create 1 rle with new method : 0.1305382251739502 create new chi : 0.2833902835845947 time to delete rle : 0.00034332275390625 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 3776 TO DO : save crop sub photo not yet done ! save time : 0.2486100196838379 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.15402007102966309 time for calcul the mask position with numpy : 0.15494370460510254 nb_pixel_total : 2068024 time to create 1 rle with new method : 0.21709179878234863 time for calcul the mask position with numpy : 0.006289243698120117 nb_pixel_total : 5576 time to create 1 rle with old method : 0.006192445755004883 create new chi : 0.3946235179901123 time to delete rle : 0.0003662109375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1290 TO DO : save crop sub photo not yet done ! save time : 0.11191272735595703 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.5098145008087158 time for calcul the mask position with numpy : 0.07819628715515137 nb_pixel_total : 1914422 time to create 1 rle with new method : 0.10836386680603027 time for calcul the mask position with numpy : 0.006625175476074219 nb_pixel_total : 4588 time to create 1 rle with old method : 0.0052258968353271484 time for calcul the mask position with numpy : 0.006854534149169922 nb_pixel_total : 24905 time to create 1 rle with old method : 0.028186798095703125 time for calcul the mask position with numpy : 0.007815361022949219 nb_pixel_total : 95565 time to create 1 rle with old method : 0.10471987724304199 time for calcul the mask position with numpy : 0.006468296051025391 nb_pixel_total : 4866 time to create 1 rle with old method : 0.005514860153198242 time for calcul the mask position with numpy : 0.0066678524017333984 nb_pixel_total : 29254 time to create 1 rle with old method : 0.0332794189453125 create new chi : 0.40839123725891113 time to delete rle : 0.0005171298980712891 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 3398 TO DO : save crop sub photo not yet done ! save time : 0.23065590858459473 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09098649024963379 time for calcul the mask position with numpy : 0.021903514862060547 nb_pixel_total : 2024181 time to create 1 rle with new method : 0.10087776184082031 time for calcul the mask position with numpy : 0.005948305130004883 nb_pixel_total : 1846 time to create 1 rle with old method : 0.0019412040710449219 time for calcul the mask position with numpy : 0.006101131439208984 nb_pixel_total : 36868 time to create 1 rle with old method : 0.03963899612426758 time for calcul the mask position with numpy : 0.006308794021606445 nb_pixel_total : 10705 time to create 1 rle with old method : 0.011878490447998047 create new chi : 0.20166015625 time to delete rle : 0.0003714561462402344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1926 TO DO : save crop sub photo not yet done ! save time : 0.13865947723388672 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.059352874755859375 time for calcul the mask position with numpy : 0.11859512329101562 nb_pixel_total : 1917993 time to create 1 rle with new method : 0.18943285942077637 time for calcul the mask position with numpy : 0.006340503692626953 nb_pixel_total : 8249 time to create 1 rle with old method : 0.009360790252685547 time for calcul the mask position with numpy : 0.006181478500366211 nb_pixel_total : 35789 time to create 1 rle with old method : 0.039324283599853516 time for calcul the mask position with numpy : 0.006528615951538086 nb_pixel_total : 100515 time to create 1 rle with old method : 0.1093747615814209 time for calcul the mask position with numpy : 0.0059888362884521484 nb_pixel_total : 11054 time to create 1 rle with old method : 0.011939287185668945 create new chi : 0.5131947994232178 time to delete rle : 0.0005354881286621094 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3060 TO DO : save crop sub photo not yet done ! save time : 0.20742177963256836 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.048709869384765625 time for calcul the mask position with numpy : 0.016919851303100586 nb_pixel_total : 837773 time to create 1 rle with new method : 0.03080272674560547 time for calcul the mask position with numpy : 0.013773441314697266 nb_pixel_total : 679842 time to create 1 rle with new method : 0.028752565383911133 time for calcul the mask position with numpy : 0.01178884506225586 nb_pixel_total : 555985 time to create 1 rle with new method : 0.028649330139160156 create new chi : 0.1315155029296875 time to delete rle : 0.0008256435394287109 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 6367 TO DO : save crop sub photo not yet done ! save time : 0.373812198638916 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11703181266784668 time for calcul the mask position with numpy : 0.05494832992553711 nb_pixel_total : 1341618 time to create 1 rle with new method : 0.2021470069885254 time for calcul the mask position with numpy : 0.011311531066894531 nb_pixel_total : 721288 time to create 1 rle with new method : 0.1070244312286377 time for calcul the mask position with numpy : 0.006313800811767578 nb_pixel_total : 10694 time to create 1 rle with old method : 0.011823654174804688 create new chi : 0.4028196334838867 time to delete rle : 0.0007736682891845703 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 3500 TO DO : save crop sub photo not yet done ! save time : 0.22805523872375488 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.20075488090515137 time for calcul the mask position with numpy : 0.08121848106384277 nb_pixel_total : 2022131 time to create 1 rle with new method : 0.16678714752197266 time for calcul the mask position with numpy : 0.006652116775512695 nb_pixel_total : 40310 time to create 1 rle with old method : 0.04625582695007324 time for calcul the mask position with numpy : 0.006889820098876953 nb_pixel_total : 5993 time to create 1 rle with old method : 0.0075953006744384766 time for calcul the mask position with numpy : 0.007685184478759766 nb_pixel_total : 5166 time to create 1 rle with old method : 0.00583958625793457 create new chi : 0.34007692337036133 time to delete rle : 0.00035381317138671875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1870 TO DO : save crop sub photo not yet done ! save time : 0.14218664169311523 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034847259521484375 time for calcul the mask position with numpy : 0.02415299415588379 nb_pixel_total : 2067627 time to create 1 rle with new method : 0.1221156120300293 time for calcul the mask position with numpy : 0.006339073181152344 nb_pixel_total : 5973 time to create 1 rle with old method : 0.006488323211669922 create new chi : 0.16615009307861328 time to delete rle : 0.0002372264862060547 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1334 TO DO : save crop sub photo not yet done ! save time : 0.11240124702453613 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.46080946922302246 time for calcul the mask position with numpy : 0.04412531852722168 nb_pixel_total : 1128762 time to create 1 rle with new method : 0.18721222877502441 time for calcul the mask position with numpy : 0.013376712799072266 nb_pixel_total : 924119 time to create 1 rle with new method : 0.15607476234436035 time for calcul the mask position with numpy : 0.0071849822998046875 nb_pixel_total : 8964 time to create 1 rle with old method : 0.010178804397583008 time for calcul the mask position with numpy : 0.006364345550537109 nb_pixel_total : 11755 time to create 1 rle with old method : 0.013107061386108398 create new chi : 0.4542725086212158 time to delete rle : 0.0010001659393310547 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4746 TO DO : save crop sub photo not yet done ! save time : 0.3077101707458496 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06240653991699219 time for calcul the mask position with numpy : 0.05964303016662598 nb_pixel_total : 1970075 time to create 1 rle with new method : 0.16899824142456055 time for calcul the mask position with numpy : 0.008243083953857422 nb_pixel_total : 82970 time to create 1 rle with old method : 0.08642768859863281 time for calcul the mask position with numpy : 0.006847858428955078 nb_pixel_total : 20555 time to create 1 rle with old method : 0.02154827117919922 create new chi : 0.36024999618530273 time to delete rle : 0.0005586147308349609 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2174 TO DO : save crop sub photo not yet done ! save time : 0.1725025177001953 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05194211006164551 time for calcul the mask position with numpy : 0.16277861595153809 nb_pixel_total : 1965290 time to create 1 rle with new method : 0.10218286514282227 time for calcul the mask position with numpy : 0.006385326385498047 nb_pixel_total : 7602 time to create 1 rle with old method : 0.008332252502441406 time for calcul the mask position with numpy : 0.0066661834716796875 nb_pixel_total : 98951 time to create 1 rle with old method : 0.10960626602172852 time for calcul the mask position with numpy : 0.006352424621582031 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0020036697387695312 create new chi : 0.41503238677978516 time to delete rle : 0.0005125999450683594 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2638 TO DO : save crop sub photo not yet done ! save time : 0.1884019374847412 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.044571876525878906 time for calcul the mask position with numpy : 0.02768397331237793 nb_pixel_total : 1975247 time to create 1 rle with new method : 0.23860526084899902 time for calcul the mask position with numpy : 0.007645368576049805 nb_pixel_total : 98353 time to create 1 rle with old method : 0.1085968017578125 create new chi : 0.39077091217041016 time to delete rle : 0.000362396240234375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2176 TO DO : save crop sub photo not yet done ! save time : 0.16717052459716797 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.21422076225280762 time for calcul the mask position with numpy : 0.11008071899414062 nb_pixel_total : 1904840 time to create 1 rle with new method : 0.19137978553771973 time for calcul the mask position with numpy : 0.006513357162475586 nb_pixel_total : 11618 time to create 1 rle with old method : 0.012647151947021484 time for calcul the mask position with numpy : 0.006375312805175781 nb_pixel_total : 26442 time to create 1 rle with old method : 0.029206514358520508 time for calcul the mask position with numpy : 0.006618976593017578 nb_pixel_total : 125626 time to create 1 rle with old method : 0.13401103019714355 time for calcul the mask position with numpy : 0.006512165069580078 nb_pixel_total : 5074 time to create 1 rle with old method : 0.005606174468994141 create new chi : 0.5194427967071533 time to delete rle : 0.0006024837493896484 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3222 TO DO : save crop sub photo not yet done ! save time : 0.21116018295288086 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07783198356628418 time for calcul the mask position with numpy : 0.05802488327026367 nb_pixel_total : 1309719 time to create 1 rle with new method : 0.13533973693847656 time for calcul the mask position with numpy : 0.0072174072265625 nb_pixel_total : 2993 time to create 1 rle with old method : 0.0032465457916259766 time for calcul the mask position with numpy : 0.011682748794555664 nb_pixel_total : 753241 time to create 1 rle with new method : 0.21340632438659668 time for calcul the mask position with numpy : 0.006283283233642578 nb_pixel_total : 2594 time to create 1 rle with old method : 0.003007173538208008 time for calcul the mask position with numpy : 0.006562232971191406 nb_pixel_total : 2154 time to create 1 rle with old method : 0.0025854110717773438 time for calcul the mask position with numpy : 0.012788772583007812 nb_pixel_total : 2899 time to create 1 rle with old method : 0.003337860107421875 create new chi : 0.4742095470428467 time to delete rle : 0.0007467269897460938 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3484 TO DO : save crop sub photo not yet done ! save time : 0.23060059547424316 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.12292671203613281 time for calcul the mask position with numpy : 0.014503717422485352 nb_pixel_total : 1143329 time to create 1 rle with new method : 0.10993242263793945 time for calcul the mask position with numpy : 0.007294893264770508 nb_pixel_total : 18100 time to create 1 rle with old method : 0.019531965255737305 time for calcul the mask position with numpy : 0.005831480026245117 nb_pixel_total : 9367 time to create 1 rle with old method : 0.010079622268676758 time for calcul the mask position with numpy : 0.01077127456665039 nb_pixel_total : 722804 time to create 1 rle with new method : 0.24158120155334473 time for calcul the mask position with numpy : 0.007977485656738281 nb_pixel_total : 127213 time to create 1 rle with old method : 0.13997387886047363 time for calcul the mask position with numpy : 0.006199359893798828 nb_pixel_total : 42876 time to create 1 rle with old method : 0.04615473747253418 time for calcul the mask position with numpy : 0.006078243255615234 nb_pixel_total : 9911 time to create 1 rle with old method : 0.010693788528442383 create new chi : 0.6469783782958984 time to delete rle : 0.0010726451873779297 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5287 TO DO : save crop sub photo not yet done ! save time : 0.31409716606140137 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.07918286323547363 time for calcul the mask position with numpy : 0.01979851722717285 nb_pixel_total : 2031560 time to create 1 rle with new method : 0.03310728073120117 time for calcul the mask position with numpy : 0.006074666976928711 nb_pixel_total : 14743 time to create 1 rle with old method : 0.016117095947265625 time for calcul the mask position with numpy : 0.0062029361724853516 nb_pixel_total : 27297 time to create 1 rle with old method : 0.02946639060974121 create new chi : 0.11771392822265625 time to delete rle : 0.0003814697265625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1958 TO DO : save crop sub photo not yet done ! save time : 0.13943147659301758 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04754900932312012 time for calcul the mask position with numpy : 0.05619931221008301 nb_pixel_total : 1968873 time to create 1 rle with new method : 0.10007882118225098 time for calcul the mask position with numpy : 0.007233142852783203 nb_pixel_total : 104727 time to create 1 rle with old method : 0.11390972137451172 create new chi : 0.2878246307373047 time to delete rle : 0.0003750324249267578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2262 TO DO : save crop sub photo not yet done ! save time : 0.1549360752105713 map_output_result : {1376599551: (0.0, 'Should be the crop_list due to order', 0), 1376599550: (0.0, 'Should be the crop_list due to order', 0), 1376599548: (0.0, 'Should be the crop_list due to order', 0), 1376599545: (0.0, 'Should be the crop_list due to order', 0), 1376599533: (0.0, 'Should be the crop_list due to order', 0), 1376599510: (0.0, 'Should be the crop_list due to order', 0), 1376599503: (0.0, 'Should be the crop_list due to order', 0), 1376599470: (0.0, 'Should be the crop_list due to order', 0), 1376599466: (0.0, 'Should be the crop_list due to order', 0), 1376599463: (0.0, 'Should be the crop_list due to order', 0), 1376599462: (0.0, 'Should be the crop_list due to order', 0), 1376599459: (0.0, 'Should be the crop_list due to order', 0), 1376599451: (0.0, 'Should be the crop_list due to order', 0), 1376599444: (0.0, 'Should be the crop_list due to order', 0), 1376599441: (0.0, 'Should be the crop_list due to order', 0), 1376599439: (0.0, 'Should be the crop_list due to order', 0), 1376599437: (0.0, 'Should be the crop_list due to order', 0), 1376599429: (0.0, 'Should be the crop_list due to order', 0), 1376599426: (0.0, 'Should be the crop_list due to order', 0), 1376599421: (0.0, 'Should be the crop_list due to order', 0), 1376599419: (0.0, 'Should be the crop_list due to order', 0), 1376599418: (0.0, 'Should be the crop_list due to order', 0), 1376599416: (0.0, 'Should be the crop_list due to order', 0), 1376599388: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1376599551, 1376599550, 1376599548, 1376599545, 1376599533, 1376599510, 1376599503, 1376599470, 1376599466, 1376599463, 1376599462, 1376599459, 1376599451, 1376599444, 1376599441, 1376599439, 1376599437, 1376599429, 1376599426, 1376599421, 1376599419, 1376599418, 1376599416, 1376599388] Looping around the photos to save general results len do output : 24 /1376599551.Didn't retrieve data . /1376599550.Didn't retrieve data . /1376599548.Didn't retrieve data . /1376599545.Didn't retrieve data . /1376599533.Didn't retrieve data . /1376599510.Didn't retrieve data . /1376599503.Didn't retrieve data . /1376599470.Didn't retrieve data . /1376599466.Didn't retrieve data . /1376599463.Didn't retrieve data . /1376599462.Didn't retrieve data . /1376599459.Didn't retrieve data . /1376599451.Didn't retrieve data . /1376599444.Didn't retrieve data . /1376599441.Didn't retrieve data . /1376599439.Didn't retrieve data . /1376599437.Didn't retrieve data . /1376599429.Didn't retrieve data . /1376599426.Didn't retrieve data . /1376599421.Didn't retrieve data . /1376599419.Didn't retrieve data . /1376599418.Didn't retrieve data . /1376599416.Didn't retrieve data . /1376599388.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599551', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599550', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599548', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599545', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599533', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599510', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599503', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599470', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599466', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599463', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599462', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599459', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599451', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599444', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599441', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599439', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599437', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599429', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599426', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599421', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599419', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599418', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599416', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599388', None, None, None, None, None, '3512841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.013974905014038086 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.395760774612427 time spend to save output : 0.014788389205932617 total time spend for step 3 : 20.41054916381836 step4:ventilate_hashtags_in_portfolio Tue Aug 12 16:02:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25915175 get user id for portfolio 25915175 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915175 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','environnement','pet_fonce','carton','pehd','pet_clair','autre','mal_croppe','metal','background','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915175 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','environnement','pet_fonce','carton','pehd','pet_clair','autre','mal_croppe','metal','background','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915175 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','environnement','pet_fonce','carton','pehd','pet_clair','autre','mal_croppe','metal','background','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25918357,25918358,25918359,25918360,25918361,25918362,25918363,25918364,25918365,25918366,25918367?tags=flou,environnement,pet_fonce,carton,pehd,pet_clair,autre,mal_croppe,metal,background,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1376599551, 1376599550, 1376599548, 1376599545, 1376599533, 1376599510, 1376599503, 1376599470, 1376599466, 1376599463, 1376599462, 1376599459, 1376599451, 1376599444, 1376599441, 1376599439, 1376599437, 1376599429, 1376599426, 1376599421, 1376599419, 1376599418, 1376599416, 1376599388] Looping around the photos to save general results len do output : 1 /25915175. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599551', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599550', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599548', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599545', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599533', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599510', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599503', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599470', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599466', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599463', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599462', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599459', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599451', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599444', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599441', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599439', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599437', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599429', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599426', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599421', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599419', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599418', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599416', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599388', None, None, None, None, None, '3512841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.019346237182617188 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.645334005355835 time spend to save output : 0.019833087921142578 total time spend for step 4 : 1.6651670932769775 step5:final Tue Aug 12 16:02:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1376599551: ('0.15671019000771605',), 1376599550: ('0.15671019000771605',), 1376599548: ('0.15671019000771605',), 1376599545: ('0.15671019000771605',), 1376599533: ('0.15671019000771605',), 1376599510: ('0.15671019000771605',), 1376599503: ('0.15671019000771605',), 1376599470: ('0.15671019000771605',), 1376599466: ('0.15671019000771605',), 1376599463: ('0.15671019000771605',), 1376599462: ('0.15671019000771605',), 1376599459: ('0.15671019000771605',), 1376599451: ('0.15671019000771605',), 1376599444: ('0.15671019000771605',), 1376599441: ('0.15671019000771605',), 1376599439: ('0.15671019000771605',), 1376599437: ('0.15671019000771605',), 1376599429: ('0.15671019000771605',), 1376599426: ('0.15671019000771605',), 1376599421: ('0.15671019000771605',), 1376599419: ('0.15671019000771605',), 1376599418: ('0.15671019000771605',), 1376599416: ('0.15671019000771605',), 1376599388: ('0.15671019000771605',)} new output for save of step final : {1376599551: ('0.15671019000771605',), 1376599550: ('0.15671019000771605',), 1376599548: ('0.15671019000771605',), 1376599545: ('0.15671019000771605',), 1376599533: ('0.15671019000771605',), 1376599510: ('0.15671019000771605',), 1376599503: ('0.15671019000771605',), 1376599470: ('0.15671019000771605',), 1376599466: ('0.15671019000771605',), 1376599463: ('0.15671019000771605',), 1376599462: ('0.15671019000771605',), 1376599459: ('0.15671019000771605',), 1376599451: ('0.15671019000771605',), 1376599444: ('0.15671019000771605',), 1376599441: ('0.15671019000771605',), 1376599439: ('0.15671019000771605',), 1376599437: ('0.15671019000771605',), 1376599429: ('0.15671019000771605',), 1376599426: ('0.15671019000771605',), 1376599421: ('0.15671019000771605',), 1376599419: ('0.15671019000771605',), 1376599418: ('0.15671019000771605',), 1376599416: ('0.15671019000771605',), 1376599388: ('0.15671019000771605',)} [1376599551, 1376599550, 1376599548, 1376599545, 1376599533, 1376599510, 1376599503, 1376599470, 1376599466, 1376599463, 1376599462, 1376599459, 1376599451, 1376599444, 1376599441, 1376599439, 1376599437, 1376599429, 1376599426, 1376599421, 1376599419, 1376599418, 1376599416, 1376599388] Looping around the photos to save general results len do output : 24 /1376599551.Didn't retrieve data . /1376599550.Didn't retrieve data . /1376599548.Didn't retrieve data . /1376599545.Didn't retrieve data . /1376599533.Didn't retrieve data . /1376599510.Didn't retrieve data . /1376599503.Didn't retrieve data . /1376599470.Didn't retrieve data . /1376599466.Didn't retrieve data . /1376599463.Didn't retrieve data . /1376599462.Didn't retrieve data . /1376599459.Didn't retrieve data . /1376599451.Didn't retrieve data . /1376599444.Didn't retrieve data . /1376599441.Didn't retrieve data . /1376599439.Didn't retrieve data . /1376599437.Didn't retrieve data . /1376599429.Didn't retrieve data . /1376599426.Didn't retrieve data . /1376599421.Didn't retrieve data . /1376599419.Didn't retrieve data . /1376599418.Didn't retrieve data . /1376599416.Didn't retrieve data . /1376599388.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599551', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599550', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599548', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599545', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599533', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599510', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599503', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599470', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599466', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599463', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599462', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599459', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599451', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599444', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599441', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599439', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599437', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599429', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599426', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599421', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599419', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599418', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599416', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599388', None, None, None, None, None, '3512841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.015985727310180664 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11553597450256348 time spend to save output : 0.01677250862121582 total time spend for step 5 : 0.1323084831237793 step6:blur_detection Tue Aug 12 16:02:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea.jpg resize: (1080, 1920) 1376599551 0.5726503374085139 treat image : temp/1755007230_1196617_1376599550_a38e30c2d8bac53f3527974214b9973a.jpg resize: (1080, 1920) 1376599550 1.2034250262985464 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010.jpg resize: (1080, 1920) 1376599548 -2.1229608637398396 treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6.jpg resize: (1080, 1920) 1376599545 -3.9195632743046054 treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b.jpg resize: (1080, 1920) 1376599533 -3.7445227813662942 treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb.jpg resize: (1080, 1920) 1376599510 -0.24011822214972983 treat image : temp/1755007230_1196617_1376599503_f960074741f594dd0547b0d6d15325d2.jpg resize: (1080, 1920) 1376599503 1.0642095468916268 treat image : temp/1755007230_1196617_1376599470_1d1fb260c37a7066869c0dc1bed73069.jpg resize: (1080, 1920) 1376599470 -0.060659425114917405 treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61.jpg resize: (1080, 1920) 1376599466 -3.462888025837345 treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559.jpg resize: (1080, 1920) 1376599463 0.7612409436485469 treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18.jpg resize: (1080, 1920) 1376599462 -3.270351455443892 treat image : temp/1755007230_1196617_1376599459_da866a9ef2561e2aa69551414df887d1.jpg resize: (1080, 1920) 1376599459 -0.6207145265940007 treat image : temp/1755007230_1196617_1376599451_15ac189087a446d206edcc991c989c96.jpg resize: (1080, 1920) 1376599451 -3.8157099690285636 treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70.jpg resize: (1080, 1920) 1376599444 0.3133868803525996 treat image : temp/1755007230_1196617_1376599441_1c5bc6ef446c9d54b64588fb9bdb5fa0.jpg resize: (1080, 1920) 1376599441 0.6341340798324221 treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3.jpg resize: (1080, 1920) 1376599439 0.05380848585135648 treat image : temp/1755007230_1196617_1376599437_401a202c66f629fad5bac26ca1c604cb.jpg resize: (1080, 1920) 1376599437 -2.8449788415225865 treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a.jpg resize: (1080, 1920) 1376599429 -3.1220994868949337 treat image : temp/1755007230_1196617_1376599426_10ad95b92e07ca8a0d88cc8081e85991.jpg resize: (1080, 1920) 1376599426 0.007377602413681481 treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08.jpg resize: (1080, 1920) 1376599421 -3.726017135033389 treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546.jpg resize: (1080, 1920) 1376599419 -0.4255449726199069 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127.jpg resize: (1080, 1920) 1376599418 -0.1327141682998856 treat image : temp/1755007230_1196617_1376599416_63c6b8f6388adf1d16b7f68d012b1c37.jpg resize: (1080, 1920) 1376599416 -2.2952714983502185 treat image : temp/1755007230_1196617_1376599388_e61e9c8fb03b131564705e657e3c98f5.jpg resize: (1080, 1920) 1376599388 -2.8215245868523278 treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea_rle_crop_3912227336_0.png resize: (149, 317) 1376631529 -0.5413797155695333 treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea_rle_crop_3912227337_0.png resize: (110, 105) 1376631531 -0.6667669024471198 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227340_0.png resize: (168, 178) 1376631532 -1.0211761477442598 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227342_0.png resize: (159, 101) 1376631534 -1.205275756176707 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227343_0.png resize: (120, 137) 1376631536 -2.3420868196040296 treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227347_0.png resize: (100, 129) 1376631537 -2.962061175341824 treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227351_0.png resize: (185, 125) 1376631538 -0.7356078768088584 treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb_rle_crop_3912227356_0.png resize: (92, 119) 1376631539 -2.7309549663725345 treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227361_0.png resize: (124, 153) 1376631541 -0.6811234087868414 treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227364_0.png resize: (63, 104) 1376631542 -3.226807990191161 treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559_rle_crop_3912227365_0.png resize: (175, 110) 1376631543 -0.34921770279310965 treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227371_0.png resize: (136, 119) 1376631545 -2.2774476441398446 treat image : temp/1755007230_1196617_1376599451_15ac189087a446d206edcc991c989c96_rle_crop_3912227374_0.png resize: (89, 200) 1376631546 -0.8781124003629014 treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70_rle_crop_3912227376_0.png resize: (72, 115) 1376631547 -1.2531791293054924 treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70_rle_crop_3912227377_0.png resize: (158, 81) 1376631548 -2.3819840530432836 treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3_rle_crop_3912227380_0.png resize: (144, 148) 1376631550 -0.4986040327786485 treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a_rle_crop_3912227385_0.png resize: (41, 59) 1376631551 0.3825263771017814 treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a_rle_crop_3912227387_0.png resize: (76, 147) 1376631552 -1.3956749072574821 treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227389_0.png resize: (164, 100) 1376631554 -3.1886660524101424 treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227393_0.png resize: (77, 62) 1376631555 -0.6009304587486952 treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227394_0.png resize: (48, 61) 1376631556 -3.060425157325748 treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227395_0.png resize: (47, 92) 1376631557 -1.7029682742149908 treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227397_0.png resize: (86, 64) 1376631559 -0.3213981354964173 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227402_0.png resize: (173, 113) 1376631560 -0.8644019648378235 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227403_0.png resize: (144, 210) 1376631561 -1.1633369975974464 treat image : temp/1755007230_1196617_1376599416_63c6b8f6388adf1d16b7f68d012b1c37_rle_crop_3912227404_0.png resize: (235, 148) 1376631563 0.2319749270966984 treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227349_0.png resize: (134, 145) 1376631574 -2.104710329508223 treat image : temp/1755007230_1196617_1376599441_1c5bc6ef446c9d54b64588fb9bdb5fa0_rle_crop_3912227379_0.png resize: (88, 111) 1376631575 -2.3954422556547907 treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3_rle_crop_3912227381_0.png resize: (135, 113) 1376631576 -1.8462392035095665 treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea_rle_crop_3912227338_0.png resize: (975, 896) 1376631921 -0.14411543855635678 treat image : temp/1755007230_1196617_1376599550_a38e30c2d8bac53f3527974214b9973a_rle_crop_3912227339_0.png resize: (140, 109) 1376631923 -0.9138926151046721 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227341_0.png resize: (135, 217) 1376631925 -2.643616301225087 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227344_0.png resize: (552, 353) 1376631926 -0.0514428701540499 treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227345_0.png resize: (185, 104) 1376631928 -0.722330966306861 treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227346_0.png resize: (286, 153) 1376631930 -3.803100848839787 treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227348_0.png resize: (119, 232) 1376631931 -3.6887310891062888 treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227350_0.png resize: (555, 326) 1376631932 -0.055110837847757145 treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227352_0.png resize: (540, 347) 1376631934 -0.22556349327055877 treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227353_0.png resize: (140, 131) 1376631936 -3.3447929501957603 treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227354_0.png resize: (129, 103) 1376631937 -1.9197444823692507 treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb_rle_crop_3912227355_0.png resize: (118, 128) 1376631939 0.574490703964209 treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb_rle_crop_3912227357_0.png resize: (131, 101) 1376631941 -3.135738098907174 treat image : temp/1755007230_1196617_1376599503_f960074741f594dd0547b0d6d15325d2_rle_crop_3912227358_0.png resize: (987, 1126) 1376631942 -0.7047430265536432 treat image : temp/1755007230_1196617_1376599470_1d1fb260c37a7066869c0dc1bed73069_rle_crop_3912227359_0.png resize: (91, 96) 1376631944 -1.431227031817941 treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227360_0.png resize: (218, 162) 1376631945 -2.2544418516226346 treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227362_0.png resize: (526, 296) 1376631947 0.1645004095411078 treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227363_0.png resize: (154, 233) 1376631948 -2.5877285359990667 treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559_rle_crop_3912227366_0.png resize: (144, 353) 1376631950 -0.9445685023441527 treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559_rle_crop_3912227367_0.png resize: (55, 46) 1376631952 -1.2254167471595918 treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227369_0.png resize: (539, 310) 1376631953 0.26630235758259685 treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227370_0.png resize: (139, 361) 1376631955 -3.422665461192373 treat image : temp/1755007230_1196617_1376599459_da866a9ef2561e2aa69551414df887d1_rle_crop_3912227372_0.png resize: (942, 972) 1376631957 -1.9225299710883608 treat image : temp/1755007230_1196617_1376599459_da866a9ef2561e2aa69551414df887d1_rle_crop_3912227373_0.png resize: (919, 1076) 1376631958 0.404686045824465 treat image : temp/1755007230_1196617_1376599451_15ac189087a446d206edcc991c989c96_rle_crop_3912227375_0.png resize: (981, 1057) 1376631959 -0.6666557014172054 treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70_rle_crop_3912227378_0.png resize: (163, 387) 1376631961 -2.7785114960879658 treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3_rle_crop_3912227382_0.png resize: (974, 1216) 1376631963 -1.1911109806730746 treat image : temp/1755007230_1196617_1376599437_401a202c66f629fad5bac26ca1c604cb_rle_crop_3912227383_0.png resize: (152, 178) 1376631964 -3.9551015695742717 treat image : temp/1755007230_1196617_1376599437_401a202c66f629fad5bac26ca1c604cb_rle_crop_3912227384_0.png resize: (380, 356) 1376631966 -0.12016500730971864 treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a_rle_crop_3912227386_0.png resize: (549, 323) 1376631968 -0.647557947700393 treat image : temp/1755007230_1196617_1376599426_10ad95b92e07ca8a0d88cc8081e85991_rle_crop_3912227388_0.png resize: (527, 318) 1376631969 0.24877794979250514 treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227390_0.png resize: (554, 371) 1376631971 -0.1432820931176405 treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227396_0.png resize: (925, 1168) 1376631973 -0.1172125283789096 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227398_0.png resize: (135, 98) 1376631974 -2.822053522521357 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227399_0.png resize: (189, 341) 1376631975 0.6375502413287328 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227400_0.png resize: (569, 373) 1376631977 -0.44886551219404464 treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227401_0.png resize: (943, 1000) 1376631979 0.3488652570772044 treat image : temp/1755007230_1196617_1376599416_63c6b8f6388adf1d16b7f68d012b1c37_rle_crop_3912227405_0.png resize: (204, 97) 1376631980 -0.7870110148819666 treat image : temp/1755007230_1196617_1376599388_e61e9c8fb03b131564705e657e3c98f5_rle_crop_3912227406_0.png resize: (578, 328) 1376631982 -0.09032454915661113 treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227368_0.png resize: (132, 132) 1376632021 -4.3001261101161345 treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227391_0.png resize: (187, 185) 1376632022 -3.2199763431831436 treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227392_0.png resize: (135, 120) 1376632024 -4.125898093560981 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.015234231948852539 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.014680624008178711 save missing photos in datou_result : time spend for datou_step_exec : 22.536932706832886 time spend to save output : 0.03554582595825195 total time spend for step 6 : 22.572478532791138 step7:brightness Tue Aug 12 16:02:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea.jpg treat image : temp/1755007230_1196617_1376599550_a38e30c2d8bac53f3527974214b9973a.jpg treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010.jpg treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6.jpg treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b.jpg treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb.jpg treat image : temp/1755007230_1196617_1376599503_f960074741f594dd0547b0d6d15325d2.jpg treat image : temp/1755007230_1196617_1376599470_1d1fb260c37a7066869c0dc1bed73069.jpg treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61.jpg treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559.jpg treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18.jpg treat image : temp/1755007230_1196617_1376599459_da866a9ef2561e2aa69551414df887d1.jpg treat image : temp/1755007230_1196617_1376599451_15ac189087a446d206edcc991c989c96.jpg treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70.jpg treat image : temp/1755007230_1196617_1376599441_1c5bc6ef446c9d54b64588fb9bdb5fa0.jpg treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3.jpg treat image : temp/1755007230_1196617_1376599437_401a202c66f629fad5bac26ca1c604cb.jpg treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a.jpg treat image : temp/1755007230_1196617_1376599426_10ad95b92e07ca8a0d88cc8081e85991.jpg treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08.jpg treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546.jpg treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127.jpg treat image : temp/1755007230_1196617_1376599416_63c6b8f6388adf1d16b7f68d012b1c37.jpg treat image : temp/1755007230_1196617_1376599388_e61e9c8fb03b131564705e657e3c98f5.jpg treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea_rle_crop_3912227336_0.png treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea_rle_crop_3912227337_0.png treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227340_0.png treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227342_0.png treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227343_0.png treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227347_0.png treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227351_0.png treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb_rle_crop_3912227356_0.png treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227361_0.png treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227364_0.png treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559_rle_crop_3912227365_0.png treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227371_0.png treat image : temp/1755007230_1196617_1376599451_15ac189087a446d206edcc991c989c96_rle_crop_3912227374_0.png treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70_rle_crop_3912227376_0.png treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70_rle_crop_3912227377_0.png treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3_rle_crop_3912227380_0.png treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a_rle_crop_3912227385_0.png treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a_rle_crop_3912227387_0.png treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227389_0.png treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227393_0.png treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227394_0.png treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227395_0.png treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227397_0.png treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227402_0.png treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227403_0.png treat image : temp/1755007230_1196617_1376599416_63c6b8f6388adf1d16b7f68d012b1c37_rle_crop_3912227404_0.png treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227349_0.png treat image : temp/1755007230_1196617_1376599441_1c5bc6ef446c9d54b64588fb9bdb5fa0_rle_crop_3912227379_0.png treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3_rle_crop_3912227381_0.png treat image : temp/1755007230_1196617_1376599551_9f13fa1dee43479e4d327967ef5978ea_rle_crop_3912227338_0.png treat image : temp/1755007230_1196617_1376599550_a38e30c2d8bac53f3527974214b9973a_rle_crop_3912227339_0.png treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227341_0.png treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227344_0.png treat image : temp/1755007230_1196617_1376599548_c3b7883622b39c4bbca60bdf28ddf010_rle_crop_3912227345_0.png treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227346_0.png treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227348_0.png treat image : temp/1755007230_1196617_1376599545_de616f67c234fe6d321c763d03e019a6_rle_crop_3912227350_0.png treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227352_0.png treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227353_0.png treat image : temp/1755007230_1196617_1376599533_9757dfc1ae47c53905dbf301e300c66b_rle_crop_3912227354_0.png treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb_rle_crop_3912227355_0.png treat image : temp/1755007230_1196617_1376599510_f34db2cfa25173569b279875871ecddb_rle_crop_3912227357_0.png treat image : temp/1755007230_1196617_1376599503_f960074741f594dd0547b0d6d15325d2_rle_crop_3912227358_0.png treat image : temp/1755007230_1196617_1376599470_1d1fb260c37a7066869c0dc1bed73069_rle_crop_3912227359_0.png treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227360_0.png treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227362_0.png treat image : temp/1755007230_1196617_1376599466_348803c88a7b0eaa9a782cd300afcd61_rle_crop_3912227363_0.png treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559_rle_crop_3912227366_0.png treat image : temp/1755007230_1196617_1376599463_78c5afc0062cff71368eabfd0b310559_rle_crop_3912227367_0.png treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227369_0.png treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227370_0.png treat image : temp/1755007230_1196617_1376599459_da866a9ef2561e2aa69551414df887d1_rle_crop_3912227372_0.png treat image : temp/1755007230_1196617_1376599459_da866a9ef2561e2aa69551414df887d1_rle_crop_3912227373_0.png treat image : temp/1755007230_1196617_1376599451_15ac189087a446d206edcc991c989c96_rle_crop_3912227375_0.png treat image : temp/1755007230_1196617_1376599444_4be58db6d20089f238289be56fafde70_rle_crop_3912227378_0.png treat image : temp/1755007230_1196617_1376599439_80863decd253e97884ef2d7646a0b8c3_rle_crop_3912227382_0.png treat image : temp/1755007230_1196617_1376599437_401a202c66f629fad5bac26ca1c604cb_rle_crop_3912227383_0.png treat image : temp/1755007230_1196617_1376599437_401a202c66f629fad5bac26ca1c604cb_rle_crop_3912227384_0.png treat image : temp/1755007230_1196617_1376599429_06a3bb52d4b62329bbfa5b346673715a_rle_crop_3912227386_0.png treat image : temp/1755007230_1196617_1376599426_10ad95b92e07ca8a0d88cc8081e85991_rle_crop_3912227388_0.png treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227390_0.png treat image : temp/1755007230_1196617_1376599419_57bd0a0f03fb238c6d7fb65d85fef546_rle_crop_3912227396_0.png treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227398_0.png treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227399_0.png treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227400_0.png treat image : temp/1755007230_1196617_1376599418_3ffdec9d881248dc8482fc7599b71127_rle_crop_3912227401_0.png treat image : temp/1755007230_1196617_1376599416_63c6b8f6388adf1d16b7f68d012b1c37_rle_crop_3912227405_0.png treat image : temp/1755007230_1196617_1376599388_e61e9c8fb03b131564705e657e3c98f5_rle_crop_3912227406_0.png treat image : temp/1755007230_1196617_1376599462_2eadd5108647ab8c3567739cb721bd18_rle_crop_3912227368_0.png treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227391_0.png treat image : temp/1755007230_1196617_1376599421_3f6c98732efd768d8f9a75fa0896fe08_rle_crop_3912227392_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 95 time used for this insertion : 0.016440868377685547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 95 time used for this insertion : 0.01779627799987793 save missing photos in datou_result : time spend for datou_step_exec : 6.387089252471924 time spend to save output : 0.03878951072692871 total time spend for step 7 : 6.4258787631988525 step8:velours_tree Tue Aug 12 16:02:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11226081848144531 time spend to save output : 5.316734313964844e-05 total time spend for step 8 : 0.11231398582458496 step9:send_mail_cod Tue Aug 12 16:02:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25915175_12-08-2025_16_02_56.pdf 25918357 imagette259183571755007376 25918359 imagette259183591755007376 25918360 change filename to text .change filename to text .change filename to text .imagette259183601755007376 25918361 imagette259183611755007376 25918362 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259183621755007376 25918363 change filename to text .change filename to text .change filename to text .imagette259183631755007377 25918364 imagette259183641755007378 25918365 imagette259183651755007378 25918366 imagette259183661755007378 25918367 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259183671755007378 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25915175 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25918357,25918358,25918359,25918360,25918361,25918362,25918363,25918364,25918365,25918366,25918367?tags=flou,environnement,pet_fonce,carton,pehd,pet_clair,autre,mal_croppe,metal,background,papier args[1376599551] : ((1376599551, 0.5726503374085139, 492688767), (1376599551, 0.48615817303260994, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599550] : ((1376599550, 1.2034250262985464, 492688767), (1376599550, 1.0499699084925873, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599548] : ((1376599548, -2.1229608637398396, 492609224), (1376599548, 0.28500747610317845, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599545] : ((1376599545, -3.9195632743046054, 492609224), (1376599545, 0.40733473039061036, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599533] : ((1376599533, -3.7445227813662942, 492609224), (1376599533, 0.3679139931769579, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599510] : ((1376599510, -0.24011822214972983, 492688767), (1376599510, 0.34566736473404436, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599503] : ((1376599503, 1.0642095468916268, 492688767), (1376599503, 0.3673496071547546, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599470] : ((1376599470, -0.060659425114917405, 492688767), (1376599470, 0.291825183449925, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599466] : ((1376599466, -3.462888025837345, 492609224), (1376599466, 0.39429335295968304, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599463] : ((1376599463, 0.7612409436485469, 492688767), (1376599463, 1.4321791012295157, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599462] : ((1376599462, -3.270351455443892, 492609224), (1376599462, 0.4197107459014446, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599459] : ((1376599459, -0.6207145265940007, 492688767), (1376599459, 0.3361120474164944, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599451] : ((1376599451, -3.8157099690285636, 492609224), (1376599451, 0.29936693859182356, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599444] : ((1376599444, 0.3133868803525996, 492688767), (1376599444, 0.17876288639235993, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599441] : ((1376599441, 0.6341340798324221, 492688767), (1376599441, 0.508137245808468, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599439] : ((1376599439, 0.05380848585135648, 492688767), (1376599439, 0.3345162240157714, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599437] : ((1376599437, -2.8449788415225865, 492609224), (1376599437, 0.7278540089296901, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599429] : ((1376599429, -3.1220994868949337, 492609224), (1376599429, 0.3386647202969974, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599426] : ((1376599426, 0.007377602413681481, 492688767), (1376599426, 0.7921369131493429, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599421] : ((1376599421, -3.726017135033389, 492609224), (1376599421, 0.23152645664794722, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599419] : ((1376599419, -0.4255449726199069, 492688767), (1376599419, 0.37092564548623486, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599418] : ((1376599418, -0.1327141682998856, 492688767), (1376599418, 0.5156653208818055, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599416] : ((1376599416, -2.2952714983502185, 492609224), (1376599416, 0.5022808600694697, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com args[1376599388] : ((1376599388, -2.8215245868523278, 492609224), (1376599388, 0.4349677575538856, 2107752395), '0.15671019000771605') We are sending mail with results at report@fotonower.com refus_total : 0.15671019000771605 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25915175 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf results_Auto_P25915175_12-08-2025_16_02_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25915175','results_Auto_P25915175_12-08-2025_16_02_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf','pdf','','0.7','0.15671019000771605') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25915175

https://www.fotonower.com/image?json=false&list_photos_id=1376599551
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599550
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2034250262985464)
https://www.fotonower.com/image?json=false&list_photos_id=1376599548
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599545
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599533
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599510
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599503
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0642095468916268)
https://www.fotonower.com/image?json=false&list_photos_id=1376599470
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599466
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599463
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599462
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599459
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599451
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599444
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599439
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599437
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599429
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599426
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599421
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599419
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599418
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599416
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376599388
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.67%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25918360?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25918362?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25918363?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25918367?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf.

Lien vers velours :https://www.fotonower.com/velours/25918357,25918358,25918359,25918360,25918361,25918362,25918363,25918364,25918365,25918366,25918367?tags=flou,environnement,pet_fonce,carton,pehd,pet_clair,autre,mal_croppe,metal,background,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 12 Aug 2025 14:03:01 GMT Content-Length: 0 Connection: close X-Message-Id: s0AxLc3HRYe7GhHuCNzbew Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1376599551, 1376599550, 1376599548, 1376599545, 1376599533, 1376599510, 1376599503, 1376599470, 1376599466, 1376599463, 1376599462, 1376599459, 1376599451, 1376599444, 1376599441, 1376599439, 1376599437, 1376599429, 1376599426, 1376599421, 1376599419, 1376599418, 1376599416, 1376599388] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599551', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599550', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599548', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599545', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599533', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599510', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599503', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599470', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599466', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599463', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599462', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599459', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599451', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599444', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599441', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599439', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599437', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599429', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599426', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599421', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599419', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599418', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599416', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599388', None, None, None, None, None, '3512841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014658689498901367 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.754568099975586 time spend to save output : 0.014974832534790039 total time spend for step 9 : 5.769542932510376 step10:split_time_score Tue Aug 12 16:03:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 24),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12082025 25915175 Nombre de photos uploadées : 24 / 23040 (0%) 12082025 25915175 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 12082025 25915175 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001256704330444336 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19456052780151367 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08963755666473765 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907306_12-08-2025_12_02_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907306 AND mptpi.`type`=3594 To do Qualite : 0.2198127786351166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908856_12-08-2025_12_01_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908856 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908856 AND mptpi.`type`=3594 To do Qualite : 0.11567090446566358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908860_12-08-2025_13_02_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908860 AND mptpi.`type`=3594 To do Qualite : 0.03421356577932099 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908864_12-08-2025_11_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908864 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908864 AND mptpi.`type`=3594 To do Qualite : 0.09985528962742503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907315_12-08-2025_12_41_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907315 AND mptpi.`type`=3594 To do Qualite : 0.24285493827160495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907317_12-08-2025_13_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907317 AND mptpi.`type`=3594 To do Qualite : 0.021655971995279587 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907323_12-08-2025_11_22_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907323 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907323 AND mptpi.`type`=3594 To do Qualite : 0.06390883349867725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907331_12-08-2025_12_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907331 AND mptpi.`type`=3594 To do Qualite : 0.03597555780606996 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915170_12-08-2025_15_21_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915170 AND mptpi.`type`=3594 To do Qualite : 0.019449749228395066 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915171_12-08-2025_15_11_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915171 AND mptpi.`type`=3594 To do Qualite : 0.0699012163204872 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915172 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 To do Qualite : 0.15671019000771605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915175 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915175 AND mptpi.`type`=3594 To do Qualite : 0.054940908926504634 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915180_12-08-2025_14_43_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915180 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12082025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1376599551, 1376599550, 1376599548, 1376599545, 1376599533, 1376599510, 1376599503, 1376599470, 1376599466, 1376599463, 1376599462, 1376599459, 1376599451, 1376599444, 1376599441, 1376599439, 1376599437, 1376599429, 1376599426, 1376599421, 1376599419, 1376599418, 1376599416, 1376599388] Looping around the photos to save general results len do output : 1 /25915175Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599551', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599550', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599548', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599545', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599533', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599510', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599503', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599470', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599466', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599463', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599462', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599459', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599451', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599444', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599441', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599439', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599437', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599429', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599426', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599421', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599419', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599418', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599416', None, None, None, None, None, '3512841') ('3318', None, None, None, None, None, None, None, '3512841') ('3318', '25915175', '1376599388', None, None, None, None, None, '3512841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.016175270080566406 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1086657047271729 time spend to save output : 0.016574382781982422 total time spend for step 10 : 1.1252400875091553 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 93.58user 34.23system 2:36.68elapsed 81%CPU (0avgtext+0avgdata 3157480maxresident)k 521416inputs+60200outputs (257major+2518135minor)pagefaults 0swaps