python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 99424 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3434936'] with mtr_portfolio_ids : ['25642068'] and first list_photo_ids : [] new path : /proc/99424/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.3495235443115234 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Aug 4 16:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-04 16:50:32.898783: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-04 16:50:32.923550: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-04 16:50:32.925755: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fae48000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-04 16:50:32.925815: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-04 16:50:32.929797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-04 16:50:33.105192: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2cd4ef80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-04 16:50:33.105248: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-04 16:50:33.106784: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-04 16:50:33.107196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 16:50:33.110541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 16:50:33.113724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-04 16:50:33.114279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-04 16:50:33.117353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-04 16:50:33.118397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-04 16:50:33.123044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-04 16:50:33.124618: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-04 16:50:33.124701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 16:50:33.125497: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-04 16:50:33.125513: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-04 16:50:33.125523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-04 16:50:33.126867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-04 16:50:33.382824: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-04 16:50:33.382956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 16:50:33.382984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 16:50:33.383010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-04 16:50:33.383034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-04 16:50:33.383058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-04 16:50:33.383082: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-04 16:50:33.383107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-04 16:50:33.384594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-04 16:50:33.385787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-04 16:50:33.385819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-04 16:50:33.385834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 16:50:33.385852: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-04 16:50:33.385865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-04 16:50:33.385879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-04 16:50:33.385893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-04 16:50:33.385907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-04 16:50:33.387152: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-04 16:50:33.387196: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-04 16:50:33.387204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-04 16:50:33.387211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-04 16:50:33.388431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-04 16:50:44.027776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-04 16:50:44.196726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 47 Detection mask done ! Trying to reset tf kernel 99998 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1667 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10733 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0004949569702148438 nb_pixel_total : 15422 time to create 1 rle with old method : 0.017510652542114258 length of segment : 139 time for calcul the mask position with numpy : 0.000934600830078125 nb_pixel_total : 41888 time to create 1 rle with old method : 0.04666018486022949 length of segment : 255 time for calcul the mask position with numpy : 0.0015912055969238281 nb_pixel_total : 77115 time to create 1 rle with old method : 0.0805823802947998 length of segment : 396 time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 19345 time to create 1 rle with old method : 0.027408599853515625 length of segment : 328 time for calcul the mask position with numpy : 0.0008895397186279297 nb_pixel_total : 52172 time to create 1 rle with old method : 0.05804133415222168 length of segment : 215 time for calcul the mask position with numpy : 0.00043272972106933594 nb_pixel_total : 15478 time to create 1 rle with old method : 0.021788358688354492 length of segment : 180 time for calcul the mask position with numpy : 0.0007319450378417969 nb_pixel_total : 35560 time to create 1 rle with old method : 0.042615413665771484 length of segment : 195 time for calcul the mask position with numpy : 0.22486615180969238 nb_pixel_total : 422480 time to create 1 rle with new method : 0.04411053657531738 length of segment : 1449 time for calcul the mask position with numpy : 0.0013802051544189453 nb_pixel_total : 45267 time to create 1 rle with old method : 0.05179142951965332 length of segment : 393 time for calcul the mask position with numpy : 0.00043201446533203125 nb_pixel_total : 26162 time to create 1 rle with old method : 0.028899192810058594 length of segment : 111 time for calcul the mask position with numpy : 0.001230001449584961 nb_pixel_total : 53190 time to create 1 rle with old method : 0.059081315994262695 length of segment : 501 time for calcul the mask position with numpy : 0.0003349781036376953 nb_pixel_total : 12748 time to create 1 rle with old method : 0.014243364334106445 length of segment : 168 time for calcul the mask position with numpy : 0.0008275508880615234 nb_pixel_total : 46432 time to create 1 rle with old method : 0.0518033504486084 length of segment : 352 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 23030 time to create 1 rle with old method : 0.024285554885864258 length of segment : 165 time for calcul the mask position with numpy : 0.0015380382537841797 nb_pixel_total : 108402 time to create 1 rle with old method : 0.11538863182067871 length of segment : 444 time for calcul the mask position with numpy : 0.003059864044189453 nb_pixel_total : 239003 time to create 1 rle with new method : 0.010636329650878906 length of segment : 463 time for calcul the mask position with numpy : 0.0009348392486572266 nb_pixel_total : 46713 time to create 1 rle with old method : 0.050206661224365234 length of segment : 298 time for calcul the mask position with numpy : 0.0015289783477783203 nb_pixel_total : 87383 time to create 1 rle with old method : 0.09313273429870605 length of segment : 596 time for calcul the mask position with numpy : 0.0008478164672851562 nb_pixel_total : 50722 time to create 1 rle with old method : 0.05575752258300781 length of segment : 461 time for calcul the mask position with numpy : 0.0004439353942871094 nb_pixel_total : 31053 time to create 1 rle with old method : 0.03332328796386719 length of segment : 274 time for calcul the mask position with numpy : 0.0003902912139892578 nb_pixel_total : 25277 time to create 1 rle with old method : 0.027554035186767578 length of segment : 153 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 22436 time to create 1 rle with old method : 0.024003982543945312 length of segment : 150 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 24404 time to create 1 rle with old method : 0.026618003845214844 length of segment : 301 time for calcul the mask position with numpy : 0.0008099079132080078 nb_pixel_total : 36386 time to create 1 rle with old method : 0.04047584533691406 length of segment : 316 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 13076 time to create 1 rle with old method : 0.014417409896850586 length of segment : 356 time for calcul the mask position with numpy : 0.0005981922149658203 nb_pixel_total : 30127 time to create 1 rle with old method : 0.03441309928894043 length of segment : 195 time for calcul the mask position with numpy : 0.0005021095275878906 nb_pixel_total : 30501 time to create 1 rle with old method : 0.03369927406311035 length of segment : 249 time for calcul the mask position with numpy : 0.0018515586853027344 nb_pixel_total : 99190 time to create 1 rle with old method : 0.10850763320922852 length of segment : 427 time for calcul the mask position with numpy : 0.003804445266723633 nb_pixel_total : 183571 time to create 1 rle with new method : 0.016432762145996094 length of segment : 723 time for calcul the mask position with numpy : 0.00032138824462890625 nb_pixel_total : 13952 time to create 1 rle with old method : 0.01651740074157715 length of segment : 171 time for calcul the mask position with numpy : 0.0007834434509277344 nb_pixel_total : 44679 time to create 1 rle with old method : 0.049407958984375 length of segment : 353 time for calcul the mask position with numpy : 0.0010595321655273438 nb_pixel_total : 56548 time to create 1 rle with old method : 0.07921767234802246 length of segment : 646 time for calcul the mask position with numpy : 0.001271963119506836 nb_pixel_total : 55152 time to create 1 rle with old method : 0.06136369705200195 length of segment : 423 time for calcul the mask position with numpy : 0.0016720294952392578 nb_pixel_total : 125151 time to create 1 rle with old method : 0.13870882987976074 length of segment : 297 time for calcul the mask position with numpy : 0.0007386207580566406 nb_pixel_total : 42736 time to create 1 rle with old method : 0.04650545120239258 length of segment : 294 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 47318 time to create 1 rle with old method : 0.05164742469787598 length of segment : 405 time for calcul the mask position with numpy : 0.0008897781372070312 nb_pixel_total : 46851 time to create 1 rle with old method : 0.07583975791931152 length of segment : 340 time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 18423 time to create 1 rle with old method : 0.020319223403930664 length of segment : 173 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 25697 time to create 1 rle with old method : 0.028456926345825195 length of segment : 181 time for calcul the mask position with numpy : 0.03342723846435547 nb_pixel_total : 820142 time to create 1 rle with new method : 0.5956692695617676 length of segment : 1121 time for calcul the mask position with numpy : 0.002112150192260742 nb_pixel_total : 138304 time to create 1 rle with old method : 0.1554889678955078 length of segment : 319 time for calcul the mask position with numpy : 0.0007383823394775391 nb_pixel_total : 52292 time to create 1 rle with old method : 0.06130170822143555 length of segment : 247 time for calcul the mask position with numpy : 0.0015151500701904297 nb_pixel_total : 44713 time to create 1 rle with old method : 0.052110910415649414 length of segment : 303 time for calcul the mask position with numpy : 0.0013928413391113281 nb_pixel_total : 74600 time to create 1 rle with old method : 0.0862116813659668 length of segment : 531 time for calcul the mask position with numpy : 0.002068758010864258 nb_pixel_total : 34937 time to create 1 rle with old method : 0.03962254524230957 length of segment : 181 time for calcul the mask position with numpy : 0.0020873546600341797 nb_pixel_total : 45830 time to create 1 rle with old method : 0.051901817321777344 length of segment : 264 time for calcul the mask position with numpy : 0.0034379959106445312 nb_pixel_total : 103595 time to create 1 rle with old method : 0.11605167388916016 length of segment : 442 time for calcul the mask position with numpy : 0.0007658004760742188 nb_pixel_total : 16361 time to create 1 rle with old method : 0.018616676330566406 length of segment : 195 time for calcul the mask position with numpy : 0.006832122802734375 nb_pixel_total : 217033 time to create 1 rle with new method : 0.008452653884887695 length of segment : 488 time for calcul the mask position with numpy : 0.0007576942443847656 nb_pixel_total : 16522 time to create 1 rle with old method : 0.018860340118408203 length of segment : 160 time for calcul the mask position with numpy : 0.0007839202880859375 nb_pixel_total : 19452 time to create 1 rle with old method : 0.021826505661010742 length of segment : 143 time for calcul the mask position with numpy : 0.0018723011016845703 nb_pixel_total : 38883 time to create 1 rle with old method : 0.042153120040893555 length of segment : 253 time for calcul the mask position with numpy : 0.002571582794189453 nb_pixel_total : 63369 time to create 1 rle with old method : 0.0694742202758789 length of segment : 355 time for calcul the mask position with numpy : 0.0006587505340576172 nb_pixel_total : 13015 time to create 1 rle with old method : 0.014294862747192383 length of segment : 184 time for calcul the mask position with numpy : 0.0012836456298828125 nb_pixel_total : 31120 time to create 1 rle with old method : 0.034235239028930664 length of segment : 202 time for calcul the mask position with numpy : 0.0003409385681152344 nb_pixel_total : 7394 time to create 1 rle with old method : 0.008318185806274414 length of segment : 65 time for calcul the mask position with numpy : 0.0027894973754882812 nb_pixel_total : 58010 time to create 1 rle with old method : 0.06418991088867188 length of segment : 426 time for calcul the mask position with numpy : 0.0013155937194824219 nb_pixel_total : 22714 time to create 1 rle with old method : 0.02870011329650879 length of segment : 196 time for calcul the mask position with numpy : 0.0011806488037109375 nb_pixel_total : 24136 time to create 1 rle with old method : 0.025974512100219727 length of segment : 227 time for calcul the mask position with numpy : 0.002362966537475586 nb_pixel_total : 58864 time to create 1 rle with old method : 0.07474184036254883 length of segment : 330 time for calcul the mask position with numpy : 0.0016663074493408203 nb_pixel_total : 36923 time to create 1 rle with old method : 0.03894400596618652 length of segment : 507 time for calcul the mask position with numpy : 0.0005872249603271484 nb_pixel_total : 30599 time to create 1 rle with old method : 0.032810211181640625 length of segment : 212 time for calcul the mask position with numpy : 0.0010480880737304688 nb_pixel_total : 36305 time to create 1 rle with old method : 0.03960013389587402 length of segment : 213 time for calcul the mask position with numpy : 0.0007104873657226562 nb_pixel_total : 5213 time to create 1 rle with old method : 0.006285429000854492 length of segment : 279 time for calcul the mask position with numpy : 0.00041222572326660156 nb_pixel_total : 5873 time to create 1 rle with old method : 0.006907939910888672 length of segment : 97 time for calcul the mask position with numpy : 0.0011322498321533203 nb_pixel_total : 30635 time to create 1 rle with old method : 0.03479504585266113 length of segment : 212 time for calcul the mask position with numpy : 0.0017964839935302734 nb_pixel_total : 35896 time to create 1 rle with old method : 0.04059958457946777 length of segment : 235 time for calcul the mask position with numpy : 0.0030133724212646484 nb_pixel_total : 72946 time to create 1 rle with old method : 0.0806419849395752 length of segment : 393 time for calcul the mask position with numpy : 0.0010859966278076172 nb_pixel_total : 26824 time to create 1 rle with old method : 0.030467987060546875 length of segment : 168 time for calcul the mask position with numpy : 0.00042700767517089844 nb_pixel_total : 16425 time to create 1 rle with old method : 0.018580913543701172 length of segment : 379 time for calcul the mask position with numpy : 0.0014684200286865234 nb_pixel_total : 97158 time to create 1 rle with old method : 0.10475802421569824 length of segment : 412 time for calcul the mask position with numpy : 0.0024576187133789062 nb_pixel_total : 112947 time to create 1 rle with old method : 0.1215212345123291 length of segment : 484 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 48439 time to create 1 rle with old method : 0.06445717811584473 length of segment : 370 time for calcul the mask position with numpy : 0.0015919208526611328 nb_pixel_total : 72638 time to create 1 rle with old method : 0.09539055824279785 length of segment : 685 time for calcul the mask position with numpy : 0.0008101463317871094 nb_pixel_total : 41247 time to create 1 rle with old method : 0.04670429229736328 length of segment : 173 time for calcul the mask position with numpy : 0.00528717041015625 nb_pixel_total : 329326 time to create 1 rle with new method : 0.01645183563232422 length of segment : 719 time for calcul the mask position with numpy : 0.0038597583770751953 nb_pixel_total : 135055 time to create 1 rle with old method : 0.14679193496704102 length of segment : 688 time for calcul the mask position with numpy : 0.02738022804260254 nb_pixel_total : 905621 time to create 1 rle with new method : 0.31610918045043945 length of segment : 1567 time for calcul the mask position with numpy : 0.004060268402099609 nb_pixel_total : 107781 time to create 1 rle with old method : 0.11790132522583008 length of segment : 411 time for calcul the mask position with numpy : 0.0017552375793457031 nb_pixel_total : 45374 time to create 1 rle with old method : 0.051657676696777344 length of segment : 212 time for calcul the mask position with numpy : 0.0012912750244140625 nb_pixel_total : 20992 time to create 1 rle with old method : 0.024302005767822266 length of segment : 197 time for calcul the mask position with numpy : 0.0011622905731201172 nb_pixel_total : 22313 time to create 1 rle with old method : 0.02557516098022461 length of segment : 245 time for calcul the mask position with numpy : 0.0011713504791259766 nb_pixel_total : 22691 time to create 1 rle with old method : 0.02622509002685547 length of segment : 205 time for calcul the mask position with numpy : 0.0006961822509765625 nb_pixel_total : 12562 time to create 1 rle with old method : 0.01471710205078125 length of segment : 142 time for calcul the mask position with numpy : 0.0007367134094238281 nb_pixel_total : 17224 time to create 1 rle with old method : 0.02016139030456543 length of segment : 181 time for calcul the mask position with numpy : 0.001432180404663086 nb_pixel_total : 19523 time to create 1 rle with old method : 0.022501707077026367 length of segment : 266 time for calcul the mask position with numpy : 0.0022249221801757812 nb_pixel_total : 56122 time to create 1 rle with old method : 0.06606864929199219 length of segment : 276 time for calcul the mask position with numpy : 0.0011897087097167969 nb_pixel_total : 20890 time to create 1 rle with old method : 0.02526259422302246 length of segment : 193 time for calcul the mask position with numpy : 0.0009899139404296875 nb_pixel_total : 17026 time to create 1 rle with old method : 0.020274639129638672 length of segment : 143 time for calcul the mask position with numpy : 0.002816438674926758 nb_pixel_total : 88838 time to create 1 rle with old method : 0.10379314422607422 length of segment : 265 time for calcul the mask position with numpy : 0.017522811889648438 nb_pixel_total : 371449 time to create 1 rle with new method : 0.025221586227416992 length of segment : 728 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 18269 time to create 1 rle with old method : 0.021245241165161133 length of segment : 143 time for calcul the mask position with numpy : 0.004200458526611328 nb_pixel_total : 76864 time to create 1 rle with old method : 0.09047698974609375 length of segment : 443 time for calcul the mask position with numpy : 0.0013837814331054688 nb_pixel_total : 21027 time to create 1 rle with old method : 0.0265810489654541 length of segment : 212 time for calcul the mask position with numpy : 0.0069086551666259766 nb_pixel_total : 180190 time to create 1 rle with new method : 0.00970458984375 length of segment : 308 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 23530 time to create 1 rle with old method : 0.025993824005126953 length of segment : 320 time for calcul the mask position with numpy : 0.0006029605865478516 nb_pixel_total : 16372 time to create 1 rle with old method : 0.018957853317260742 length of segment : 150 time for calcul the mask position with numpy : 0.0027146339416503906 nb_pixel_total : 83421 time to create 1 rle with old method : 0.09424281120300293 length of segment : 380 time for calcul the mask position with numpy : 0.0010194778442382812 nb_pixel_total : 23836 time to create 1 rle with old method : 0.026967525482177734 length of segment : 274 time for calcul the mask position with numpy : 0.002691507339477539 nb_pixel_total : 42198 time to create 1 rle with old method : 0.051310062408447266 length of segment : 375 time for calcul the mask position with numpy : 0.0017635822296142578 nb_pixel_total : 45025 time to create 1 rle with old method : 0.05096244812011719 length of segment : 205 time for calcul the mask position with numpy : 0.0009582042694091797 nb_pixel_total : 15668 time to create 1 rle with old method : 0.01779913902282715 length of segment : 222 time for calcul the mask position with numpy : 0.0014796257019042969 nb_pixel_total : 33776 time to create 1 rle with old method : 0.038376569747924805 length of segment : 241 time for calcul the mask position with numpy : 0.0007927417755126953 nb_pixel_total : 25817 time to create 1 rle with old method : 0.029300928115844727 length of segment : 162 time spent for convertir_results : 11.556715965270996 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 104 chid ids of type : 3594 Number RLEs to save : 34860 save missing photos in datou_result : time spend for datou_step_exec : 74.49000549316406 time spend to save output : 2.020747184753418 total time spend for step 1 : 76.51075267791748 step2:crop_condition Mon Aug 4 16:51:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 104 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 87 About to insert : list_path_to_insert length 87 new photo from crops ! About to upload 87 photos upload in portfolio : 3736932 init cache_photo without model_param we have 87 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754319139_99424 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 87 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.46417737007141 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754319165_99424 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3299620151519775 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754319172_99424 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3276011943817139 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754319174_99424 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5836288928985596 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375128355, 1375128342, 1375128333, 1375128331, 1375128330, 1375128329, 1375128284] Looping around the photos to save general results len do output : 104 /1375135546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375135664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128355', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128342', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128333', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128331', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128330', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128329', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128284', None, None, None, None, None, '3434936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 319 time used for this insertion : 0.02676677703857422 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.490238904953 time spend to save output : 0.030659914016723633 total time spend for step 2 : 68.52089881896973 step3:rle_unique_nms_with_priority Mon Aug 4 16:52:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 104 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 6.885713577270508 time for calcul the mask position with numpy : 1.2093720436096191 nb_pixel_total : 7411788 time to create 1 rle with new method : 1.0939345359802246 time for calcul the mask position with numpy : 0.02402806282043457 nb_pixel_total : 23030 time to create 1 rle with old method : 0.024472951889038086 time for calcul the mask position with numpy : 0.024564504623413086 nb_pixel_total : 46432 time to create 1 rle with old method : 0.04905867576599121 time for calcul the mask position with numpy : 0.024555206298828125 nb_pixel_total : 12748 time to create 1 rle with old method : 0.013635635375976562 time for calcul the mask position with numpy : 0.024411678314208984 nb_pixel_total : 53190 time to create 1 rle with old method : 0.05598783493041992 time for calcul the mask position with numpy : 0.023436307907104492 nb_pixel_total : 26162 time to create 1 rle with old method : 0.027495384216308594 time for calcul the mask position with numpy : 0.02411174774169922 nb_pixel_total : 41590 time to create 1 rle with old method : 0.04407691955566406 time for calcul the mask position with numpy : 0.026641845703125 nb_pixel_total : 422480 time to create 1 rle with new method : 0.6636331081390381 time for calcul the mask position with numpy : 0.02727675437927246 nb_pixel_total : 35560 time to create 1 rle with old method : 0.039839982986450195 time for calcul the mask position with numpy : 0.02596259117126465 nb_pixel_total : 15478 time to create 1 rle with old method : 0.017525911331176758 time for calcul the mask position with numpy : 0.028523921966552734 nb_pixel_total : 52172 time to create 1 rle with old method : 0.059488534927368164 time for calcul the mask position with numpy : 0.02576303482055664 nb_pixel_total : 19345 time to create 1 rle with old method : 0.022319316864013672 time for calcul the mask position with numpy : 0.026495933532714844 nb_pixel_total : 77115 time to create 1 rle with old method : 0.08381390571594238 time for calcul the mask position with numpy : 0.02477097511291504 nb_pixel_total : 41888 time to create 1 rle with old method : 0.04408860206604004 time for calcul the mask position with numpy : 0.02400660514831543 nb_pixel_total : 15422 time to create 1 rle with old method : 0.01624131202697754 create new chi : 3.887647867202759 time to delete rle : 0.030467748641967773 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11623 TO DO : save crop sub photo not yet done ! save time : 0.697899341583252 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 10.464614629745483 time for calcul the mask position with numpy : 0.6846351623535156 nb_pixel_total : 7109661 time to create 1 rle with new method : 1.04371976852417 time for calcul the mask position with numpy : 0.025031566619873047 nb_pixel_total : 55152 time to create 1 rle with old method : 0.0771951675415039 time for calcul the mask position with numpy : 0.027257919311523438 nb_pixel_total : 56548 time to create 1 rle with old method : 0.06518769264221191 time for calcul the mask position with numpy : 0.026011228561401367 nb_pixel_total : 44679 time to create 1 rle with old method : 0.048111915588378906 time for calcul the mask position with numpy : 0.024907827377319336 nb_pixel_total : 13952 time to create 1 rle with old method : 0.015259981155395508 time for calcul the mask position with numpy : 0.02684807777404785 nb_pixel_total : 183571 time to create 1 rle with new method : 0.9410643577575684 time for calcul the mask position with numpy : 0.027867794036865234 nb_pixel_total : 89231 time to create 1 rle with old method : 0.09539055824279785 time for calcul the mask position with numpy : 0.026698827743530273 nb_pixel_total : 30501 time to create 1 rle with old method : 0.033617258071899414 time for calcul the mask position with numpy : 0.02691173553466797 nb_pixel_total : 29663 time to create 1 rle with old method : 0.031822919845581055 time for calcul the mask position with numpy : 0.025078535079956055 nb_pixel_total : 13076 time to create 1 rle with old method : 0.014231443405151367 time for calcul the mask position with numpy : 0.024510622024536133 nb_pixel_total : 36386 time to create 1 rle with old method : 0.038451433181762695 time for calcul the mask position with numpy : 0.023773193359375 nb_pixel_total : 24404 time to create 1 rle with old method : 0.026311159133911133 time for calcul the mask position with numpy : 0.02461409568786621 nb_pixel_total : 22436 time to create 1 rle with old method : 0.024021148681640625 time for calcul the mask position with numpy : 0.024433374404907227 nb_pixel_total : 25277 time to create 1 rle with old method : 0.0266416072845459 time for calcul the mask position with numpy : 0.022695064544677734 nb_pixel_total : 27640 time to create 1 rle with old method : 0.02833104133605957 time for calcul the mask position with numpy : 0.02393054962158203 nb_pixel_total : 50722 time to create 1 rle with old method : 0.05302000045776367 time for calcul the mask position with numpy : 0.024552583694458008 nb_pixel_total : 87383 time to create 1 rle with old method : 0.09157919883728027 time for calcul the mask position with numpy : 0.02337169647216797 nb_pixel_total : 46713 time to create 1 rle with old method : 0.04839444160461426 time for calcul the mask position with numpy : 0.02544426918029785 nb_pixel_total : 239003 time to create 1 rle with new method : 0.5747756958007812 time for calcul the mask position with numpy : 0.024052143096923828 nb_pixel_total : 108402 time to create 1 rle with old method : 0.11197090148925781 create new chi : 4.644527435302734 time to delete rle : 0.0017638206481933594 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 15812 TO DO : save crop sub photo not yet done ! save time : 0.9322988986968994 nb_obj : 7 nb_hashtags : 1 time to prepare the origin masks : 4.072131156921387 time for calcul the mask position with numpy : 1.125885009765625 nb_pixel_total : 7168218 time to create 1 rle with new method : 0.865330696105957 time for calcul the mask position with numpy : 0.028830528259277344 nb_pixel_total : 820006 time to create 1 rle with new method : 0.7918980121612549 time for calcul the mask position with numpy : 0.027904033660888672 nb_pixel_total : 25697 time to create 1 rle with old method : 0.027264118194580078 time for calcul the mask position with numpy : 0.02941131591796875 nb_pixel_total : 18423 time to create 1 rle with old method : 0.019709110260009766 time for calcul the mask position with numpy : 0.026236534118652344 nb_pixel_total : 46851 time to create 1 rle with old method : 0.05002546310424805 time for calcul the mask position with numpy : 0.026998519897460938 nb_pixel_total : 47318 time to create 1 rle with old method : 0.05016207695007324 time for calcul the mask position with numpy : 0.025165796279907227 nb_pixel_total : 42736 time to create 1 rle with old method : 0.0461268424987793 time for calcul the mask position with numpy : 0.02508544921875 nb_pixel_total : 125151 time to create 1 rle with old method : 0.1320323944091797 create new chi : 3.3710527420043945 time to delete rle : 0.0010182857513427734 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 7749 TO DO : save crop sub photo not yet done ! save time : 0.4819459915161133 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 2.0254225730895996 time for calcul the mask position with numpy : 0.7016730308532715 nb_pixel_total : 7984491 time to create 1 rle with new method : 0.9340674877166748 time for calcul the mask position with numpy : 0.025212764739990234 nb_pixel_total : 74600 time to create 1 rle with old method : 0.08213591575622559 time for calcul the mask position with numpy : 0.024368762969970703 nb_pixel_total : 44713 time to create 1 rle with old method : 0.04703497886657715 time for calcul the mask position with numpy : 0.02331686019897461 nb_pixel_total : 52292 time to create 1 rle with old method : 0.055123090744018555 time for calcul the mask position with numpy : 0.025394201278686523 nb_pixel_total : 138304 time to create 1 rle with old method : 0.14962530136108398 create new chi : 2.1202690601348877 time to delete rle : 0.0006453990936279297 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4960 TO DO : save crop sub photo not yet done ! save time : 0.31708431243896484 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 10.403830766677856 time for calcul the mask position with numpy : 0.5236530303955078 nb_pixel_total : 7241951 time to create 1 rle with new method : 0.850482702255249 time for calcul the mask position with numpy : 0.039638519287109375 nb_pixel_total : 26824 time to create 1 rle with old method : 0.02886819839477539 time for calcul the mask position with numpy : 0.0234224796295166 nb_pixel_total : 72946 time to create 1 rle with old method : 0.0913841724395752 time for calcul the mask position with numpy : 0.027570009231567383 nb_pixel_total : 35896 time to create 1 rle with old method : 0.043267011642456055 time for calcul the mask position with numpy : 0.02524089813232422 nb_pixel_total : 30635 time to create 1 rle with old method : 0.03404974937438965 time for calcul the mask position with numpy : 0.025091171264648438 nb_pixel_total : 5873 time to create 1 rle with old method : 0.006617307662963867 time for calcul the mask position with numpy : 0.025304079055786133 nb_pixel_total : 5213 time to create 1 rle with old method : 0.006094694137573242 time for calcul the mask position with numpy : 0.02628469467163086 nb_pixel_total : 36305 time to create 1 rle with old method : 0.04191422462463379 time for calcul the mask position with numpy : 0.02430105209350586 nb_pixel_total : 30599 time to create 1 rle with old method : 0.03243541717529297 time for calcul the mask position with numpy : 0.024933338165283203 nb_pixel_total : 36923 time to create 1 rle with old method : 0.03939676284790039 time for calcul the mask position with numpy : 0.023789405822753906 nb_pixel_total : 58864 time to create 1 rle with old method : 0.06189417839050293 time for calcul the mask position with numpy : 0.024994373321533203 nb_pixel_total : 24136 time to create 1 rle with old method : 0.025499582290649414 time for calcul the mask position with numpy : 0.023868560791015625 nb_pixel_total : 22714 time to create 1 rle with old method : 0.023950815200805664 time for calcul the mask position with numpy : 0.024431705474853516 nb_pixel_total : 58010 time to create 1 rle with old method : 0.05983281135559082 time for calcul the mask position with numpy : 0.02384805679321289 nb_pixel_total : 7394 time to create 1 rle with old method : 0.007877111434936523 time for calcul the mask position with numpy : 0.023251056671142578 nb_pixel_total : 31120 time to create 1 rle with old method : 0.03272366523742676 time for calcul the mask position with numpy : 0.023203134536743164 nb_pixel_total : 13015 time to create 1 rle with old method : 0.013752222061157227 time for calcul the mask position with numpy : 0.025000810623168945 nb_pixel_total : 63369 time to create 1 rle with old method : 0.06824111938476562 time for calcul the mask position with numpy : 0.024918794631958008 nb_pixel_total : 38883 time to create 1 rle with old method : 0.03994560241699219 time for calcul the mask position with numpy : 0.023820877075195312 nb_pixel_total : 19452 time to create 1 rle with old method : 0.019994497299194336 time for calcul the mask position with numpy : 0.024034500122070312 nb_pixel_total : 16522 time to create 1 rle with old method : 0.017040014266967773 time for calcul the mask position with numpy : 0.02512502670288086 nb_pixel_total : 217033 time to create 1 rle with new method : 0.7177419662475586 time for calcul the mask position with numpy : 0.02418231964111328 nb_pixel_total : 16361 time to create 1 rle with old method : 0.017313480377197266 time for calcul the mask position with numpy : 0.025962352752685547 nb_pixel_total : 103595 time to create 1 rle with old method : 0.10679435729980469 time for calcul the mask position with numpy : 0.02383565902709961 nb_pixel_total : 45830 time to create 1 rle with old method : 0.04703402519226074 time for calcul the mask position with numpy : 0.02490091323852539 nb_pixel_total : 34937 time to create 1 rle with old method : 0.03742480278015137 create new chi : 3.694749116897583 time to delete rle : 0.001888275146484375 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15014 TO DO : save crop sub photo not yet done ! save time : 0.868903636932373 nb_obj : 9 nb_hashtags : 1 time to prepare the origin masks : 3.623802900314331 time for calcul the mask position with numpy : 0.5258240699768066 nb_pixel_total : 6543793 time to create 1 rle with new method : 0.7436070442199707 time for calcul the mask position with numpy : 0.029951095581054688 nb_pixel_total : 900926 time to create 1 rle with new method : 0.8523025512695312 time for calcul the mask position with numpy : 0.024401187896728516 nb_pixel_total : 135055 time to create 1 rle with old method : 0.14146828651428223 time for calcul the mask position with numpy : 0.024641036987304688 nb_pixel_total : 329326 time to create 1 rle with new method : 0.822298526763916 time for calcul the mask position with numpy : 0.024283647537231445 nb_pixel_total : 41247 time to create 1 rle with old method : 0.04597043991088867 time for calcul the mask position with numpy : 0.026098012924194336 nb_pixel_total : 69084 time to create 1 rle with old method : 0.07756567001342773 time for calcul the mask position with numpy : 0.026408910751342773 nb_pixel_total : 48439 time to create 1 rle with old method : 0.052506208419799805 time for calcul the mask position with numpy : 0.024845361709594727 nb_pixel_total : 112947 time to create 1 rle with old method : 0.11749124526977539 time for calcul the mask position with numpy : 0.0237884521484375 nb_pixel_total : 97158 time to create 1 rle with old method : 0.09907412528991699 time for calcul the mask position with numpy : 0.026134252548217773 nb_pixel_total : 16425 time to create 1 rle with old method : 0.01743912696838379 create new chi : 3.819149971008301 time to delete rle : 0.0017001628875732422 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12760 TO DO : save crop sub photo not yet done ! save time : 0.7324507236480713 nb_obj : 26 nb_hashtags : 4 time to prepare the origin masks : 4.307628870010376 time for calcul the mask position with numpy : 0.5290911197662354 nb_pixel_total : 6883478 time to create 1 rle with new method : 0.8408265113830566 time for calcul the mask position with numpy : 0.03305506706237793 nb_pixel_total : 88838 time to create 1 rle with old method : 0.09720349311828613 time for calcul the mask position with numpy : 0.032846689224243164 nb_pixel_total : 33776 time to create 1 rle with old method : 0.03602409362792969 time for calcul the mask position with numpy : 0.03261303901672363 nb_pixel_total : 16372 time to create 1 rle with old method : 0.017524003982543945 time for calcul the mask position with numpy : 0.033097028732299805 nb_pixel_total : 82577 time to create 1 rle with old method : 0.08845758438110352 time for calcul the mask position with numpy : 0.03345322608947754 nb_pixel_total : 45374 time to create 1 rle with old method : 0.049710988998413086 time for calcul the mask position with numpy : 0.03429532051086426 nb_pixel_total : 20890 time to create 1 rle with old method : 0.028924942016601562 time for calcul the mask position with numpy : 0.03839755058288574 nb_pixel_total : 23836 time to create 1 rle with old method : 0.03539395332336426 time for calcul the mask position with numpy : 0.03262066841125488 nb_pixel_total : 22313 time to create 1 rle with old method : 0.024237871170043945 time for calcul the mask position with numpy : 0.03390097618103027 nb_pixel_total : 15668 time to create 1 rle with old method : 0.01717400550842285 time for calcul the mask position with numpy : 0.03367781639099121 nb_pixel_total : 17026 time to create 1 rle with old method : 0.0184323787689209 time for calcul the mask position with numpy : 0.033827781677246094 nb_pixel_total : 107781 time to create 1 rle with old method : 0.13359951972961426 time for calcul the mask position with numpy : 0.034421443939208984 nb_pixel_total : 76864 time to create 1 rle with old method : 0.08428478240966797 time for calcul the mask position with numpy : 0.03301715850830078 nb_pixel_total : 45025 time to create 1 rle with old method : 0.048790693283081055 time for calcul the mask position with numpy : 0.033153533935546875 nb_pixel_total : 56122 time to create 1 rle with old method : 0.061383962631225586 time for calcul the mask position with numpy : 0.035184383392333984 nb_pixel_total : 180190 time to create 1 rle with new method : 0.7486934661865234 time for calcul the mask position with numpy : 0.03315925598144531 nb_pixel_total : 21027 time to create 1 rle with old method : 0.02239704132080078 time for calcul the mask position with numpy : 0.032904624938964844 nb_pixel_total : 18269 time to create 1 rle with old method : 0.019737958908081055 time for calcul the mask position with numpy : 0.033136606216430664 nb_pixel_total : 25817 time to create 1 rle with old method : 0.0285336971282959 time for calcul the mask position with numpy : 0.033771514892578125 nb_pixel_total : 17224 time to create 1 rle with old method : 0.018708229064941406 time for calcul the mask position with numpy : 0.033867835998535156 nb_pixel_total : 22691 time to create 1 rle with old method : 0.025383949279785156 time for calcul the mask position with numpy : 0.03515768051147461 nb_pixel_total : 13762 time to create 1 rle with old method : 0.015604972839355469 time for calcul the mask position with numpy : 0.035126686096191406 nb_pixel_total : 364205 time to create 1 rle with new method : 0.8352608680725098 time for calcul the mask position with numpy : 0.03476595878601074 nb_pixel_total : 20992 time to create 1 rle with old method : 0.02243185043334961 time for calcul the mask position with numpy : 0.03270459175109863 nb_pixel_total : 12562 time to create 1 rle with old method : 0.013848304748535156 time for calcul the mask position with numpy : 0.033528804779052734 nb_pixel_total : 42198 time to create 1 rle with old method : 0.04575228691101074 time for calcul the mask position with numpy : 0.03328204154968262 nb_pixel_total : 19523 time to create 1 rle with old method : 0.021384716033935547 create new chi : 4.895070791244507 time to delete rle : 0.002073526382446289 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15705 TO DO : save crop sub photo not yet done ! save time : 0.9192781448364258 map_output_result : {1375128355: (0.0, 'Should be the crop_list due to order', 0), 1375128342: (0.0, 'Should be the crop_list due to order', 0), 1375128333: (0.0, 'Should be the crop_list due to order', 0), 1375128331: (0.0, 'Should be the crop_list due to order', 0), 1375128330: (0.0, 'Should be the crop_list due to order', 0), 1375128329: (0.0, 'Should be the crop_list due to order', 0), 1375128284: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375128355, 1375128342, 1375128333, 1375128331, 1375128330, 1375128329, 1375128284] Looping around the photos to save general results len do output : 7 /1375128355.Didn't retrieve data . /1375128342.Didn't retrieve data . /1375128333.Didn't retrieve data . /1375128331.Didn't retrieve data . /1375128330.Didn't retrieve data . /1375128329.Didn't retrieve data . /1375128284.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128355', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128342', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128333', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128331', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128330', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128329', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128284', None, None, None, None, None, '3434936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.020528078079223633 save_final save missing photos in datou_result : time spend for datou_step_exec : 74.29225587844849 time spend to save output : 0.022510051727294922 total time spend for step 3 : 74.31476593017578 step4:ventilate_hashtags_in_portfolio Mon Aug 4 16:54:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25642068 get user id for portfolio 25642068 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25642068 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','flou','metal','autre','pet_fonce','background','carton','pet_clair','environnement','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25642068 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','flou','metal','autre','pet_fonce','background','carton','pet_clair','environnement','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25642068 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','flou','metal','autre','pet_fonce','background','carton','pet_clair','environnement','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25642560,25642561,25642562,25642563,25642564,25642565,25642566,25642567,25642568,25642569,25642570?tags=mal_croppe,papier,flou,metal,autre,pet_fonce,background,carton,pet_clair,environnement,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375128355, 1375128342, 1375128333, 1375128331, 1375128330, 1375128329, 1375128284] Looping around the photos to save general results len do output : 1 /25642068. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128355', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128342', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128333', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128331', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128330', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128329', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128284', None, None, None, None, None, '3434936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014150142669677734 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7374241352081299 time spend to save output : 0.01445460319519043 total time spend for step 4 : 1.7518787384033203 step5:final Mon Aug 4 16:54:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375128355: ('0.13291962907848326',), 1375128342: ('0.13291962907848326',), 1375128333: ('0.13291962907848326',), 1375128331: ('0.13291962907848326',), 1375128330: ('0.13291962907848326',), 1375128329: ('0.13291962907848326',), 1375128284: ('0.13291962907848326',)} new output for save of step final : {1375128355: ('0.13291962907848326',), 1375128342: ('0.13291962907848326',), 1375128333: ('0.13291962907848326',), 1375128331: ('0.13291962907848326',), 1375128330: ('0.13291962907848326',), 1375128329: ('0.13291962907848326',), 1375128284: ('0.13291962907848326',)} [1375128355, 1375128342, 1375128333, 1375128331, 1375128330, 1375128329, 1375128284] Looping around the photos to save general results len do output : 7 /1375128355.Didn't retrieve data . /1375128342.Didn't retrieve data . /1375128333.Didn't retrieve data . /1375128331.Didn't retrieve data . /1375128330.Didn't retrieve data . /1375128329.Didn't retrieve data . /1375128284.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128355', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128342', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128333', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128331', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128330', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128329', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128284', None, None, None, None, None, '3434936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.014939308166503906 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12952876091003418 time spend to save output : 0.015572309494018555 total time spend for step 5 : 0.14510107040405273 step6:blur_detection Mon Aug 4 16:54:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189.jpg resize: (2160, 3840) 1375128355 -7.134860715488739 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117.jpg resize: (2160, 3840) 1375128342 -7.080336457982262 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307.jpg resize: (2160, 3840) 1375128333 -7.389688403410678 treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b.jpg resize: (2160, 3840) 1375128331 -7.405285380731286 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a.jpg resize: (2160, 3840) 1375128330 -7.34234609063708 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191.jpg resize: (2160, 3840) 1375128329 -7.31694801408532 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38.jpg resize: (2160, 3840) 1375128284 -7.177931736344804 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647331_0.png resize: (124, 171) 1375135546 -3.506502584201225 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647332_0.png resize: (246, 262) 1375135547 -2.93396810433645 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647334_0.png resize: (265, 142) 1375135548 -3.1055734918671645 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647337_0.png resize: (195, 254) 1375135549 -4.566748204189902 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647338_0.png resize: (764, 979) 1375135550 -1.7009856167154065 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647339_0.png resize: (250, 351) 1375135551 -4.294589863384063 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647345_0.png resize: (443, 367) 1375135552 -2.1250070229697657 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647346_0.png resize: (435, 703) 1375135553 -0.700388687634009 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647347_0.png resize: (263, 253) 1375135554 -1.2541126512284093 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647348_0.png resize: (556, 233) 1375135555 -3.05912609825717 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647349_0.png resize: (384, 191) 1375135557 -0.8832588113939487 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647350_0.png resize: (273, 159) 1375135558 -3.192699819024466 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647351_0.png resize: (141, 275) 1375135559 -4.435040045213624 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647353_0.png resize: (301, 224) 1375135560 -3.2573109818186383 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647354_0.png resize: (257, 298) 1375135561 -2.438578208232126 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647355_0.png resize: (202, 190) 1375135562 -3.4153564177363958 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647356_0.png resize: (161, 325) 1375135563 -3.436530517667665 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647357_0.png resize: (243, 165) 1375135564 -2.1141974335502125 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647358_0.png resize: (303, 744) 1375135565 -4.59863728288901 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647359_0.png resize: (565, 780) 1375135566 -1.677775764508507 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647362_0.png resize: (428, 239) 1375135567 0.5596985545861091 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647363_0.png resize: (422, 303) 1375135568 -4.161537602997499 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647364_0.png resize: (290, 602) 1375135569 -0.5793818608083934 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647365_0.png resize: (294, 227) 1375135570 -2.5173077480341073 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647366_0.png resize: (256, 253) 1375135571 -5.100368511037028 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647367_0.png resize: (315, 213) 1375135572 -5.153531578977205 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647368_0.png resize: (157, 208) 1375135573 -0.6098447111039771 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647369_0.png resize: (175, 242) 1375135575 -4.748217344457901 treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647370_0.png resize: (1033, 962) 1375135576 -5.002566106632959 treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647371_0.png resize: (305, 617) 1375135577 -2.062296951713422 treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647372_0.png resize: (247, 265) 1375135578 -5.0573636362893835 treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647373_0.png resize: (293, 241) 1375135579 -3.573599480441714 treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647374_0.png resize: (507, 258) 1375135580 -3.7899533865643216 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647375_0.png resize: (178, 357) 1375135581 0.24610954304461585 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647376_0.png resize: (244, 299) 1375135582 -1.367718934667529 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647377_0.png resize: (442, 335) 1375135583 0.6599552721158193 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647379_0.png resize: (448, 656) 1375135584 -0.9268748961311658 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647380_0.png resize: (153, 201) 1375135585 -3.0991553934501326 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647381_0.png resize: (143, 230) 1375135586 1.8953114442841505 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647382_0.png resize: (252, 282) 1375135587 -3.6415817796682646 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647383_0.png resize: (344, 242) 1375135588 -4.705568346024817 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647384_0.png resize: (184, 99) 1375135589 -3.4127902058632347 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647385_0.png resize: (202, 217) 1375135590 -0.49681847909151816 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647386_0.png resize: (63, 140) 1375135591 -2.1664010465727928 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647387_0.png resize: (424, 283) 1375135592 -3.2112190530070746 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647388_0.png resize: (196, 232) 1375135593 -0.37120729318748713 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647389_0.png resize: (208, 195) 1375135594 -3.5778846371857282 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647390_0.png resize: (206, 432) 1375135595 -4.010316696093629 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647391_0.png resize: (299, 193) 1375135596 -0.47888918861022056 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647392_0.png resize: (212, 180) 1375135597 -0.12035690887283251 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647393_0.png resize: (213, 232) 1375135598 -4.009607345333556 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647394_0.png resize: (158, 138) 1375135599 -2.975201445108756 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647395_0.png resize: (97, 79) 1375135600 -2.2297310140322124 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647396_0.png resize: (210, 212) 1375135602 2.6811028281495792 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647397_0.png resize: (234, 246) 1375135603 -4.466575034210977 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647399_0.png resize: (168, 211) 1375135604 -0.4912567745104244 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647400_0.png resize: (277, 155) 1375135605 -3.0426934545858106 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647401_0.png resize: (412, 435) 1375135606 0.7860370531534415 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647402_0.png resize: (484, 478) 1375135607 -1.2457438093344535 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647403_0.png resize: (360, 181) 1375135608 -5.647940989431265 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647404_0.png resize: (567, 241) 1375135609 -4.543560003223183 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647405_0.png resize: (172, 423) 1375135611 -2.7197587096269045 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647406_0.png resize: (498, 821) 1375135612 -5.174836706208178 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647407_0.png resize: (402, 509) 1375135613 -5.115621466294782 treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647408_0.png resize: (1177, 1477) 1375135614 -4.775288431009532 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647409_0.png resize: (410, 310) 1375135615 1.6497515855759086 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647410_0.png resize: (212, 258) 1375135616 -3.715668999218683 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647411_0.png resize: (188, 163) 1375135617 -2.999084396536622 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647412_0.png resize: (242, 110) 1375135618 -2.3079665109650156 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647413_0.png resize: (200, 153) 1375135619 -2.617497648892455 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647414_0.png resize: (138, 117) 1375135620 -3.1078795097300254 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647415_0.png resize: (181, 138) 1375135621 -3.2812418100167506 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647417_0.png resize: (274, 260) 1375135622 -1.8424557252811078 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647418_0.png resize: (193, 143) 1375135623 -3.3461722249085573 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647419_0.png resize: (121, 190) 1375135624 -2.1184876894017126 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647421_0.png resize: (497, 1175) 1375135625 -4.765018339688865 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647422_0.png resize: (143, 184) 1375135626 -2.278218645115738 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647423_0.png resize: (371, 301) 1375135627 -3.9424387353197936 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647424_0.png resize: (211, 147) 1375135628 -3.82264594123405 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647426_0.png resize: (281, 161) 1375135629 -4.037381683635117 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647427_0.png resize: (150, 165) 1375135630 -2.9490324991536965 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647428_0.png resize: (380, 379) 1375135631 -3.472947257591051 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647429_0.png resize: (274, 151) 1375135632 -4.24424754992525 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647430_0.png resize: (347, 301) 1375135633 -1.8906197628389008 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647431_0.png resize: (167, 396) 1375135634 -1.5838839288028637 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647432_0.png resize: (221, 99) 1375135635 -3.2396156652933272 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647433_0.png resize: (241, 212) 1375135636 -2.175534173022411 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647333_0.png resize: (394, 267) 1375135644 -4.116565897401509 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647335_0.png resize: (212, 341) 1375135645 0.5898836758486353 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647336_0.png resize: (180, 131) 1375135646 -4.138473398116187 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647340_0.png resize: (105, 316) 1375135647 -4.020430228806311 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647341_0.png resize: (303, 372) 1375135648 -0.12869536801462195 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647342_0.png resize: (166, 116) 1375135649 -4.296775241533792 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647343_0.png resize: (352, 194) 1375135650 -4.427479886219544 treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647344_0.png resize: (160, 171) 1375135651 -4.071570361136789 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647352_0.png resize: (150, 237) 1375135652 -3.3999110679529263 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647361_0.png resize: (310, 231) 1375135653 -4.827479856202885 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647378_0.png resize: (177, 149) 1375135654 -4.112248446657497 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647416_0.png resize: (261, 134) 1375135655 -3.2612367234108355 treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647360_0.png resize: (171, 159) 1375135659 -3.501516296162282 treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647398_0.png resize: (368, 268) 1375135660 -4.662362549110921 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647420_0.png resize: (251, 413) 1375135661 -4.644981294836419 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647425_0.png resize: (265, 936) 1375135662 -4.290765492379706 treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647434_0.png resize: (143, 235) 1375135664 -3.2974561937650635 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 111 time used for this insertion : 0.020322561264038086 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 111 time used for this insertion : 0.034620046615600586 save missing photos in datou_result : time spend for datou_step_exec : 31.733194589614868 time spend to save output : 0.06318330764770508 total time spend for step 6 : 31.796377897262573 step7:brightness Mon Aug 4 16:54:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189.jpg treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117.jpg treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307.jpg treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b.jpg treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a.jpg treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191.jpg treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38.jpg treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647331_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647332_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647334_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647337_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647338_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647339_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647345_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647346_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647347_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647348_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647349_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647350_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647351_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647353_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647354_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647355_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647356_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647357_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647358_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647359_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647362_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647363_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647364_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647365_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647366_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647367_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647368_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647369_0.png treat image : temp/1754319028_99424_1375128333_55820c1daad3ac71fb2427e172098307_rle_crop_3902647370_0.png treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647371_0.png treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647372_0.png treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647373_0.png treat image : temp/1754319028_99424_1375128331_3f50332fbf30e986351498c2f1ac515b_rle_crop_3902647374_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647375_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647376_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647377_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647379_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647380_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647381_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647382_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647383_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647384_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647385_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647386_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647387_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647388_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647389_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647390_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647391_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647392_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647393_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647394_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647395_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647396_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647397_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647399_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647400_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647401_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647402_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647403_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647404_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647405_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647406_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647407_0.png treat image : temp/1754319028_99424_1375128329_39a43d4587a35f99e62e508a5400a191_rle_crop_3902647408_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647409_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647410_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647411_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647412_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647413_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647414_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647415_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647417_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647418_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647419_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647421_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647422_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647423_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647424_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647426_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647427_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647428_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647429_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647430_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647431_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647432_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647433_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647333_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647335_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647336_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647340_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647341_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647342_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647343_0.png treat image : temp/1754319028_99424_1375128355_12284a43b2e06fa2adb935c7fe56d189_rle_crop_3902647344_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647352_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647361_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647378_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647416_0.png treat image : temp/1754319028_99424_1375128342_7501b3e41e1ab615b120938316621117_rle_crop_3902647360_0.png treat image : temp/1754319028_99424_1375128330_ff517aa0c7c92619f80b4a20cd99936a_rle_crop_3902647398_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647420_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647425_0.png treat image : temp/1754319028_99424_1375128284_7d93d991fc66a0b801a89a1b9082cd38_rle_crop_3902647434_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 111 time used for this insertion : 0.015951156616210938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 111 time used for this insertion : 0.035482168197631836 save missing photos in datou_result : time spend for datou_step_exec : 8.170278310775757 time spend to save output : 0.056633949279785156 total time spend for step 7 : 8.226912260055542 step8:velours_tree Mon Aug 4 16:54:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.20978760719299316 time spend to save output : 0.00011587142944335938 total time spend for step 8 : 0.20990347862243652 step9:send_mail_cod Mon Aug 4 16:54:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25642068_04-08-2025_16_54_51.pdf 25642560 imagette256425601754319291 25642561 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256425611754319291 25642562 imagette256425621754319293 25642563 imagette256425631754319293 25642564 change filename to text .imagette256425641754319293 25642565 imagette256425651754319293 25642566 imagette256425661754319293 25642567 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256425671754319293 25642568 change filename to text .change filename to text .change filename to text .change filename to text .imagette256425681754319294 25642570 imagette256425701754319294 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25642068 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25642560,25642561,25642562,25642563,25642564,25642565,25642566,25642567,25642568,25642569,25642570?tags=mal_croppe,papier,flou,metal,autre,pet_fonce,background,carton,pet_clair,environnement,pehd args[1375128355] : ((1375128355, -7.134860715488739, 492609224), (1375128355, 1.1529558672261608, 2107752395), '0.13291962907848326') We are sending mail with results at report@fotonower.com args[1375128342] : ((1375128342, -7.080336457982262, 492609224), (1375128342, 1.9934762217429227, 2107752395), '0.13291962907848326') We are sending mail with results at report@fotonower.com args[1375128333] : ((1375128333, -7.389688403410678, 492609224), (1375128333, 1.8045516774298302, 2107752395), '0.13291962907848326') We are sending mail with results at report@fotonower.com args[1375128331] : ((1375128331, -7.405285380731286, 492609224), (1375128331, 1.8115711913379513, 2107752395), '0.13291962907848326') We are sending mail with results at report@fotonower.com args[1375128330] : ((1375128330, -7.34234609063708, 492609224), (1375128330, 1.6570833539048113, 2107752395), '0.13291962907848326') We are sending mail with results at report@fotonower.com args[1375128329] : ((1375128329, -7.31694801408532, 492609224), (1375128329, 2.068654432353817, 492649241), '0.13291962907848326') We are sending mail with results at report@fotonower.com args[1375128284] : ((1375128284, -7.177931736344804, 492609224), (1375128284, 0.9018734189122585, 2107752395), '0.13291962907848326') We are sending mail with results at report@fotonower.com refus_total : 0.13291962907848326 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25642068 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25642068_04-08-2025_16_54_51.pdf results_Auto_P25642068_04-08-2025_16_54_51.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25642068_04-08-2025_16_54_51.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25642068','results_Auto_P25642068_04-08-2025_16_54_51.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25642068_04-08-2025_16_54_51.pdf','pdf','','0.58','0.13291962907848326') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25642068

https://www.fotonower.com/image?json=false&list_photos_id=1375128355
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375128342
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375128333
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375128331
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375128330
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375128329
La photo est trop lumineuse, merci de reprendre une photo.(avec le score = 2.068654432353817,le score doit entre -2 et 2)
https://www.fotonower.com/image?json=false&list_photos_id=1375128284
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.29%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/25642561?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25642564?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25642567?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25642568?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25642068_04-08-2025_16_54_51.pdf.

Lien vers velours :https://www.fotonower.com/velours/25642560,25642561,25642562,25642563,25642564,25642565,25642566,25642567,25642568,25642569,25642570?tags=mal_croppe,papier,flou,metal,autre,pet_fonce,background,carton,pet_clair,environnement,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 04 Aug 2025 14:54:57 GMT Content-Length: 0 Connection: close X-Message-Id: OVp-BKmPSYyNg6wpSF1jtg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375128355, 1375128342, 1375128333, 1375128331, 1375128330, 1375128329, 1375128284] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128355', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128342', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128333', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128331', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128330', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128329', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128284', None, None, None, None, None, '3434936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.018773555755615234 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.105661153793335 time spend to save output : 0.01898670196533203 total time spend for step 9 : 6.124647855758667 step10:split_time_score Mon Aug 4 16:54:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 04082025 25642068 Nombre de photos uploadées : 7 / 23040 (0%) 04082025 25642068 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 04082025 25642068 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00038123130798339844 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20743966102600098 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.04300052567766396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25632565_04-08-2025_09_42_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25632565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25632565 AND mptpi.`type`=3726 To do Qualite : 0.026639430089980366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25636904_04-08-2025_12_27_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25636904 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25636904 AND mptpi.`type`=3726 To do Qualite : 0.03452949622086746 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25639150_04-08-2025_14_13_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25639150 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25639150 AND mptpi.`type`=3726 To do Qualite : 0.13291962907848326 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25642068_04-08-2025_16_54_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25642068 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25642068 AND mptpi.`type`=3594 To do Qualite : 0.1620980541087963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25642070_04-08-2025_16_47_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25642070 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25642070 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'04082025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375128355, 1375128342, 1375128333, 1375128331, 1375128330, 1375128329, 1375128284] Looping around the photos to save general results len do output : 1 /25642068Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128355', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128342', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128333', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128331', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128330', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128329', None, None, None, None, None, '3434936') ('3318', None, None, None, None, None, None, None, '3434936') ('3318', '25642068', '1375128284', None, None, None, None, None, '3434936') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013684988021850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.68914794921875 time spend to save output : 0.013863086700439453 total time spend for step 10 : 0.7030110359191895 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 121.17user 116.68system 4:32.53elapsed 87%CPU (0avgtext+0avgdata 5001980maxresident)k 591896inputs+109136outputs (7331major+10963747minor)pagefaults 0swaps