python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 694946 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3335247'] with mtr_portfolio_ids : ['25259010'] and first list_photo_ids : [] new path : /proc/694946/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.0269746780395508 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Jul 24 07:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5665 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-24 07:40:33.146564: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-24 07:40:33.171641: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-24 07:40:33.173247: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f93a0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-24 07:40:33.173293: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-24 07:40:33.175786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-24 07:40:33.303510: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3b3ea0f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-24 07:40:33.303540: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-24 07:40:33.304270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 07:40:33.304542: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 07:40:33.306605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 07:40:33.308664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 07:40:33.308973: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 07:40:33.311129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 07:40:33.312374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 07:40:33.318080: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 07:40:33.319608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 07:40:33.319692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 07:40:33.320499: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 07:40:33.320520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 07:40:33.320532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 07:40:33.321947: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-24 07:40:33.571055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 07:40:33.571188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 07:40:33.571214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 07:40:33.571234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 07:40:33.571254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 07:40:33.571272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 07:40:33.571291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 07:40:33.571310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 07:40:33.572565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 07:40:33.573786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 07:40:33.573823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 07:40:33.573842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 07:40:33.573860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 07:40:33.573878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 07:40:33.573896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 07:40:33.573914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 07:40:33.573932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 07:40:33.575198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 07:40:33.575240: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 07:40:33.575252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 07:40:33.575262: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 07:40:33.576503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-24 07:40:45.565186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 07:40:45.744501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 07:40:47.108964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:47.109885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:47.933845: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-07-24 07:40:48.015433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.015516: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.017251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.017282: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.025347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.025375: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.026154: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.026174: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.059216: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.059310: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.059339: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-24 07:40:48.060232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.060265: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.061363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.061396: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.068682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.068709: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.069422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.069442: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.070181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.070200: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 07:40:48.070925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.079228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.079969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.097847: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.099012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.100041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.100819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.105174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.105962: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.106733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.107487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.108729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.119306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.120106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.129562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.130363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.131129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.131919: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.132641: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 07:40:48.133372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 Detection mask done ! Trying to reset tf kernel 695520 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4472 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002681255340576172 nb_pixel_total : 48340 time to create 1 rle with old method : 0.07625794410705566 length of segment : 345 time for calcul the mask position with numpy : 0.0007319450378417969 nb_pixel_total : 26297 time to create 1 rle with old method : 0.029085397720336914 length of segment : 258 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 14123 time to create 1 rle with old method : 0.0160825252532959 length of segment : 130 time for calcul the mask position with numpy : 0.00023818016052246094 nb_pixel_total : 10114 time to create 1 rle with old method : 0.01155710220336914 length of segment : 136 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 16837 time to create 1 rle with old method : 0.020228862762451172 length of segment : 146 time for calcul the mask position with numpy : 0.0038433074951171875 nb_pixel_total : 123001 time to create 1 rle with old method : 0.19552350044250488 length of segment : 452 time for calcul the mask position with numpy : 0.0018510818481445312 nb_pixel_total : 91362 time to create 1 rle with old method : 0.11267709732055664 length of segment : 398 time for calcul the mask position with numpy : 0.0015034675598144531 nb_pixel_total : 27913 time to create 1 rle with old method : 0.04761552810668945 length of segment : 334 time for calcul the mask position with numpy : 0.0007164478302001953 nb_pixel_total : 30974 time to create 1 rle with old method : 0.03678536415100098 length of segment : 259 time for calcul the mask position with numpy : 0.0009789466857910156 nb_pixel_total : 45337 time to create 1 rle with old method : 0.0549015998840332 length of segment : 309 time for calcul the mask position with numpy : 0.0007195472717285156 nb_pixel_total : 24994 time to create 1 rle with old method : 0.044350385665893555 length of segment : 288 time for calcul the mask position with numpy : 0.0011174678802490234 nb_pixel_total : 50443 time to create 1 rle with old method : 0.0690927505493164 length of segment : 479 time for calcul the mask position with numpy : 0.0016896724700927734 nb_pixel_total : 82533 time to create 1 rle with old method : 0.10232019424438477 length of segment : 582 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 31316 time to create 1 rle with old method : 0.042366743087768555 length of segment : 195 time for calcul the mask position with numpy : 0.0003826618194580078 nb_pixel_total : 14819 time to create 1 rle with old method : 0.02144598960876465 length of segment : 159 time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 9963 time to create 1 rle with old method : 0.012179136276245117 length of segment : 144 time for calcul the mask position with numpy : 0.00025010108947753906 nb_pixel_total : 10502 time to create 1 rle with old method : 0.013062000274658203 length of segment : 134 time for calcul the mask position with numpy : 0.0011436939239501953 nb_pixel_total : 21086 time to create 1 rle with old method : 0.02540755271911621 length of segment : 226 time for calcul the mask position with numpy : 0.0010128021240234375 nb_pixel_total : 14619 time to create 1 rle with old method : 0.017552614212036133 length of segment : 173 time for calcul the mask position with numpy : 0.0010232925415039062 nb_pixel_total : 16412 time to create 1 rle with old method : 0.02060842514038086 length of segment : 201 time for calcul the mask position with numpy : 0.00420832633972168 nb_pixel_total : 115647 time to create 1 rle with old method : 0.1401982307434082 length of segment : 592 time for calcul the mask position with numpy : 0.0007677078247070312 nb_pixel_total : 38839 time to create 1 rle with old method : 0.04581475257873535 length of segment : 274 time for calcul the mask position with numpy : 0.0017011165618896484 nb_pixel_total : 94143 time to create 1 rle with old method : 0.11008381843566895 length of segment : 612 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 4695 time to create 1 rle with old method : 0.005630016326904297 length of segment : 111 time for calcul the mask position with numpy : 0.0027222633361816406 nb_pixel_total : 90863 time to create 1 rle with old method : 0.11049056053161621 length of segment : 522 time for calcul the mask position with numpy : 0.0010230541229248047 nb_pixel_total : 36328 time to create 1 rle with old method : 0.04240250587463379 length of segment : 386 time for calcul the mask position with numpy : 0.0012769699096679688 nb_pixel_total : 48169 time to create 1 rle with old method : 0.06123661994934082 length of segment : 354 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 13873 time to create 1 rle with old method : 0.022952556610107422 length of segment : 128 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 8390 time to create 1 rle with old method : 0.010405302047729492 length of segment : 114 time for calcul the mask position with numpy : 0.001374959945678711 nb_pixel_total : 19338 time to create 1 rle with old method : 0.02414870262145996 length of segment : 137 time for calcul the mask position with numpy : 0.00036597251892089844 nb_pixel_total : 13618 time to create 1 rle with old method : 0.016170978546142578 length of segment : 140 time for calcul the mask position with numpy : 0.0015635490417480469 nb_pixel_total : 39465 time to create 1 rle with old method : 0.04589486122131348 length of segment : 286 time for calcul the mask position with numpy : 0.0015170574188232422 nb_pixel_total : 24351 time to create 1 rle with old method : 0.028156042098999023 length of segment : 318 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 6465 time to create 1 rle with old method : 0.007721662521362305 length of segment : 83 time for calcul the mask position with numpy : 0.0008883476257324219 nb_pixel_total : 16872 time to create 1 rle with old method : 0.019675731658935547 length of segment : 141 time for calcul the mask position with numpy : 0.0011036396026611328 nb_pixel_total : 22596 time to create 1 rle with old method : 0.026653051376342773 length of segment : 178 time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 28987 time to create 1 rle with old method : 0.034503936767578125 length of segment : 216 time for calcul the mask position with numpy : 0.0011038780212402344 nb_pixel_total : 39727 time to create 1 rle with old method : 0.04731583595275879 length of segment : 255 time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 13351 time to create 1 rle with old method : 0.01658916473388672 length of segment : 130 time for calcul the mask position with numpy : 0.0005645751953125 nb_pixel_total : 22108 time to create 1 rle with old method : 0.027259349822998047 length of segment : 201 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 17734 time to create 1 rle with old method : 0.05420112609863281 length of segment : 160 time for calcul the mask position with numpy : 0.0008156299591064453 nb_pixel_total : 22619 time to create 1 rle with old method : 0.027399539947509766 length of segment : 237 time for calcul the mask position with numpy : 0.002505064010620117 nb_pixel_total : 58716 time to create 1 rle with old method : 0.06910133361816406 length of segment : 715 time for calcul the mask position with numpy : 0.0010304450988769531 nb_pixel_total : 24287 time to create 1 rle with old method : 0.029230117797851562 length of segment : 340 time for calcul the mask position with numpy : 0.0019922256469726562 nb_pixel_total : 42414 time to create 1 rle with old method : 0.05150747299194336 length of segment : 350 time for calcul the mask position with numpy : 0.0025086402893066406 nb_pixel_total : 32078 time to create 1 rle with old method : 0.0427548885345459 length of segment : 168 time for calcul the mask position with numpy : 0.0011763572692871094 nb_pixel_total : 13596 time to create 1 rle with old method : 0.016629457473754883 length of segment : 251 time for calcul the mask position with numpy : 0.000997304916381836 nb_pixel_total : 34218 time to create 1 rle with old method : 0.06949472427368164 length of segment : 240 time for calcul the mask position with numpy : 0.0029442310333251953 nb_pixel_total : 5780 time to create 1 rle with old method : 0.009875774383544922 length of segment : 225 time for calcul the mask position with numpy : 0.01783585548400879 nb_pixel_total : 258039 time to create 1 rle with new method : 0.05016207695007324 length of segment : 723 time for calcul the mask position with numpy : 0.0030791759490966797 nb_pixel_total : 58822 time to create 1 rle with old method : 0.06987404823303223 length of segment : 256 time for calcul the mask position with numpy : 0.0022559165954589844 nb_pixel_total : 78475 time to create 1 rle with old method : 0.0914146900177002 length of segment : 593 time for calcul the mask position with numpy : 0.003977298736572266 nb_pixel_total : 43218 time to create 1 rle with old method : 0.0524449348449707 length of segment : 562 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 6114 time to create 1 rle with old method : 0.007434844970703125 length of segment : 214 time for calcul the mask position with numpy : 0.0031540393829345703 nb_pixel_total : 51398 time to create 1 rle with old method : 0.061533451080322266 length of segment : 433 time for calcul the mask position with numpy : 0.0011434555053710938 nb_pixel_total : 15031 time to create 1 rle with old method : 0.017747879028320312 length of segment : 427 time for calcul the mask position with numpy : 0.0017845630645751953 nb_pixel_total : 17468 time to create 1 rle with old method : 0.021184682846069336 length of segment : 262 time for calcul the mask position with numpy : 0.0016407966613769531 nb_pixel_total : 44197 time to create 1 rle with old method : 0.05160188674926758 length of segment : 240 time for calcul the mask position with numpy : 0.0017852783203125 nb_pixel_total : 40702 time to create 1 rle with old method : 0.04742908477783203 length of segment : 387 time for calcul the mask position with numpy : 0.004109621047973633 nb_pixel_total : 101686 time to create 1 rle with old method : 0.11676526069641113 length of segment : 399 time for calcul the mask position with numpy : 0.0007009506225585938 nb_pixel_total : 12519 time to create 1 rle with old method : 0.014742374420166016 length of segment : 185 time for calcul the mask position with numpy : 0.0013637542724609375 nb_pixel_total : 39868 time to create 1 rle with old method : 0.04644322395324707 length of segment : 213 time for calcul the mask position with numpy : 0.0020284652709960938 nb_pixel_total : 52913 time to create 1 rle with old method : 0.061560630798339844 length of segment : 276 time for calcul the mask position with numpy : 0.0015358924865722656 nb_pixel_total : 26121 time to create 1 rle with old method : 0.030330419540405273 length of segment : 384 time for calcul the mask position with numpy : 0.0015435218811035156 nb_pixel_total : 36161 time to create 1 rle with old method : 0.04231572151184082 length of segment : 236 time for calcul the mask position with numpy : 0.0005221366882324219 nb_pixel_total : 7902 time to create 1 rle with old method : 0.008981943130493164 length of segment : 158 time for calcul the mask position with numpy : 0.0017566680908203125 nb_pixel_total : 33784 time to create 1 rle with old method : 0.0401151180267334 length of segment : 213 time for calcul the mask position with numpy : 0.0036149024963378906 nb_pixel_total : 63392 time to create 1 rle with old method : 0.07469701766967773 length of segment : 395 time for calcul the mask position with numpy : 0.002953767776489258 nb_pixel_total : 90090 time to create 1 rle with old method : 0.10361719131469727 length of segment : 385 time for calcul the mask position with numpy : 0.0004367828369140625 nb_pixel_total : 10193 time to create 1 rle with old method : 0.011896133422851562 length of segment : 115 time for calcul the mask position with numpy : 0.0008387565612792969 nb_pixel_total : 21890 time to create 1 rle with old method : 0.02624344825744629 length of segment : 160 time for calcul the mask position with numpy : 0.011165380477905273 nb_pixel_total : 242420 time to create 1 rle with new method : 0.019517898559570312 length of segment : 818 time for calcul the mask position with numpy : 0.0017919540405273438 nb_pixel_total : 62666 time to create 1 rle with old method : 0.07345056533813477 length of segment : 329 time for calcul the mask position with numpy : 0.0018804073333740234 nb_pixel_total : 40804 time to create 1 rle with old method : 0.047693729400634766 length of segment : 369 time for calcul the mask position with numpy : 0.0012485980987548828 nb_pixel_total : 32450 time to create 1 rle with old method : 0.03767704963684082 length of segment : 297 time for calcul the mask position with numpy : 0.0030417442321777344 nb_pixel_total : 47898 time to create 1 rle with old method : 0.05499100685119629 length of segment : 413 time for calcul the mask position with numpy : 0.0010025501251220703 nb_pixel_total : 22738 time to create 1 rle with old method : 0.025876760482788086 length of segment : 187 time for calcul the mask position with numpy : 0.004101753234863281 nb_pixel_total : 73852 time to create 1 rle with old method : 0.08375000953674316 length of segment : 346 time for calcul the mask position with numpy : 0.004160404205322266 nb_pixel_total : 85188 time to create 1 rle with old method : 0.09686732292175293 length of segment : 253 time for calcul the mask position with numpy : 0.0013644695281982422 nb_pixel_total : 34533 time to create 1 rle with old method : 0.04061627388000488 length of segment : 240 time for calcul the mask position with numpy : 0.002748727798461914 nb_pixel_total : 70514 time to create 1 rle with old method : 0.08175230026245117 length of segment : 312 time for calcul the mask position with numpy : 0.0020570755004882812 nb_pixel_total : 41692 time to create 1 rle with old method : 0.049160003662109375 length of segment : 248 time for calcul the mask position with numpy : 0.003454446792602539 nb_pixel_total : 88880 time to create 1 rle with old method : 0.10477662086486816 length of segment : 266 time for calcul the mask position with numpy : 0.0019233226776123047 nb_pixel_total : 38659 time to create 1 rle with old method : 0.04562067985534668 length of segment : 211 time for calcul the mask position with numpy : 0.007200479507446289 nb_pixel_total : 213704 time to create 1 rle with new method : 0.012308120727539062 length of segment : 546 time for calcul the mask position with numpy : 0.0011773109436035156 nb_pixel_total : 24367 time to create 1 rle with old method : 0.02812933921813965 length of segment : 334 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 14702 time to create 1 rle with old method : 0.01730966567993164 length of segment : 107 time for calcul the mask position with numpy : 0.010088920593261719 nb_pixel_total : 183029 time to create 1 rle with new method : 0.033826351165771484 length of segment : 788 time for calcul the mask position with numpy : 0.0036988258361816406 nb_pixel_total : 77285 time to create 1 rle with old method : 0.10993194580078125 length of segment : 447 time for calcul the mask position with numpy : 0.0020751953125 nb_pixel_total : 59798 time to create 1 rle with old method : 0.07002377510070801 length of segment : 432 time for calcul the mask position with numpy : 0.0013039112091064453 nb_pixel_total : 23494 time to create 1 rle with old method : 0.02750539779663086 length of segment : 222 time for calcul the mask position with numpy : 0.004667520523071289 nb_pixel_total : 139040 time to create 1 rle with old method : 0.16012215614318848 length of segment : 417 time for calcul the mask position with numpy : 0.0009777545928955078 nb_pixel_total : 28542 time to create 1 rle with old method : 0.03304028511047363 length of segment : 194 time for calcul the mask position with numpy : 0.0018062591552734375 nb_pixel_total : 57828 time to create 1 rle with old method : 0.06684160232543945 length of segment : 396 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 21838 time to create 1 rle with old method : 0.024839162826538086 length of segment : 230 time for calcul the mask position with numpy : 0.0004668235778808594 nb_pixel_total : 8011 time to create 1 rle with old method : 0.00947260856628418 length of segment : 125 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 14548 time to create 1 rle with old method : 0.017017126083374023 length of segment : 127 time for calcul the mask position with numpy : 0.00203704833984375 nb_pixel_total : 59313 time to create 1 rle with old method : 0.06706786155700684 length of segment : 276 time for calcul the mask position with numpy : 0.0010838508605957031 nb_pixel_total : 19082 time to create 1 rle with old method : 0.022815942764282227 length of segment : 373 time for calcul the mask position with numpy : 0.0008022785186767578 nb_pixel_total : 21667 time to create 1 rle with old method : 0.02590465545654297 length of segment : 165 time for calcul the mask position with numpy : 0.0017783641815185547 nb_pixel_total : 56872 time to create 1 rle with old method : 0.06709074974060059 length of segment : 350 time for calcul the mask position with numpy : 0.0011718273162841797 nb_pixel_total : 37459 time to create 1 rle with old method : 0.04326653480529785 length of segment : 189 time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 10132 time to create 1 rle with old method : 0.011622190475463867 length of segment : 126 time for calcul the mask position with numpy : 0.0017931461334228516 nb_pixel_total : 59412 time to create 1 rle with old method : 0.0697014331817627 length of segment : 312 time for calcul the mask position with numpy : 0.0028710365295410156 nb_pixel_total : 115934 time to create 1 rle with old method : 0.13327240943908691 length of segment : 458 time for calcul the mask position with numpy : 0.0003771781921386719 nb_pixel_total : 12299 time to create 1 rle with old method : 0.014595508575439453 length of segment : 93 time for calcul the mask position with numpy : 0.0033521652221679688 nb_pixel_total : 137692 time to create 1 rle with old method : 0.16060233116149902 length of segment : 442 time for calcul the mask position with numpy : 0.002627849578857422 nb_pixel_total : 65911 time to create 1 rle with old method : 0.07347559928894043 length of segment : 419 time for calcul the mask position with numpy : 0.0012080669403076172 nb_pixel_total : 30128 time to create 1 rle with old method : 0.03511238098144531 length of segment : 218 time for calcul the mask position with numpy : 0.0016906261444091797 nb_pixel_total : 61701 time to create 1 rle with old method : 0.06991267204284668 length of segment : 280 time for calcul the mask position with numpy : 0.0010845661163330078 nb_pixel_total : 17373 time to create 1 rle with old method : 0.020682096481323242 length of segment : 151 time for calcul the mask position with numpy : 0.0005717277526855469 nb_pixel_total : 7897 time to create 1 rle with old method : 0.009625434875488281 length of segment : 166 time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 10301 time to create 1 rle with old method : 0.012181282043457031 length of segment : 149 time for calcul the mask position with numpy : 0.0010218620300292969 nb_pixel_total : 35454 time to create 1 rle with old method : 0.040636539459228516 length of segment : 442 time spent for convertir_results : 11.005216360092163 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 114 chid ids of type : 3594 Number RLEs to save : 33691 save missing photos in datou_result : time spend for datou_step_exec : 64.08370471000671 time spend to save output : 5.285865306854248 total time spend for step 1 : 69.36957001686096 step2:crop_condition Thu Jul 24 07:41:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 114 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 97 About to insert : list_path_to_insert length 97 new photo from crops ! About to upload 97 photos upload in portfolio : 3736932 init cache_photo without model_param we have 97 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753335723_694946 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 97 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.13030457496643 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753335751_694946 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7840659618377686 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753335757_694946 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.507969856262207 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753335761_694946 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.619706392288208 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373460825, 1373460816, 1373460815, 1373460813, 1373460810, 1373460786] Looping around the photos to save general results len do output : 114 /1373468252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373468399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460825', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460816', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460815', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460813', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460810', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460786', None, None, None, None, None, '3335247') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 348 time used for this insertion : 0.5726642608642578 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.623584270477295 time spend to save output : 0.577160120010376 total time spend for step 2 : 62.20074439048767 step3:rle_unique_nms_with_priority Thu Jul 24 07:42:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 114 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 7.392768621444702 time for calcul the mask position with numpy : 0.761772632598877 nb_pixel_total : 7644687 time to create 1 rle with new method : 1.0210983753204346 time for calcul the mask position with numpy : 0.025689363479614258 nb_pixel_total : 10502 time to create 1 rle with old method : 0.012134075164794922 time for calcul the mask position with numpy : 0.025525808334350586 nb_pixel_total : 9963 time to create 1 rle with old method : 0.011790275573730469 time for calcul the mask position with numpy : 0.025190114974975586 nb_pixel_total : 5718 time to create 1 rle with old method : 0.00662994384765625 time for calcul the mask position with numpy : 0.02443099021911621 nb_pixel_total : 31316 time to create 1 rle with old method : 0.03545689582824707 time for calcul the mask position with numpy : 0.02592945098876953 nb_pixel_total : 82533 time to create 1 rle with old method : 0.11295914649963379 time for calcul the mask position with numpy : 0.0259549617767334 nb_pixel_total : 50443 time to create 1 rle with old method : 0.05749011039733887 time for calcul the mask position with numpy : 0.024031639099121094 nb_pixel_total : 24994 time to create 1 rle with old method : 0.028087377548217773 time for calcul the mask position with numpy : 0.027216196060180664 nb_pixel_total : 45337 time to create 1 rle with old method : 0.05175924301147461 time for calcul the mask position with numpy : 0.030210494995117188 nb_pixel_total : 30974 time to create 1 rle with old method : 0.034375905990600586 time for calcul the mask position with numpy : 0.025554895401000977 nb_pixel_total : 27859 time to create 1 rle with old method : 0.03122997283935547 time for calcul the mask position with numpy : 0.02557206153869629 nb_pixel_total : 91362 time to create 1 rle with old method : 0.10308623313903809 time for calcul the mask position with numpy : 0.026609420776367188 nb_pixel_total : 123001 time to create 1 rle with old method : 0.1392059326171875 time for calcul the mask position with numpy : 0.02534627914428711 nb_pixel_total : 16837 time to create 1 rle with old method : 0.019109249114990234 time for calcul the mask position with numpy : 0.02400350570678711 nb_pixel_total : 10114 time to create 1 rle with old method : 0.01148676872253418 time for calcul the mask position with numpy : 0.024286746978759766 nb_pixel_total : 14123 time to create 1 rle with old method : 0.015743017196655273 time for calcul the mask position with numpy : 0.02491307258605957 nb_pixel_total : 26297 time to create 1 rle with old method : 0.03421211242675781 time for calcul the mask position with numpy : 0.0414729118347168 nb_pixel_total : 48340 time to create 1 rle with old method : 0.05477404594421387 create new chi : 3.0320725440979004 time to delete rle : 0.02856302261352539 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 11515 TO DO : save crop sub photo not yet done ! save time : 3.4187400341033936 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 10.123504400253296 time for calcul the mask position with numpy : 0.8356854915618896 nb_pixel_total : 7660984 time to create 1 rle with new method : 0.9029638767242432 time for calcul the mask position with numpy : 0.0240325927734375 nb_pixel_total : 22596 time to create 1 rle with old method : 0.025923490524291992 time for calcul the mask position with numpy : 0.02373361587524414 nb_pixel_total : 16872 time to create 1 rle with old method : 0.019212722778320312 time for calcul the mask position with numpy : 0.02491474151611328 nb_pixel_total : 6465 time to create 1 rle with old method : 0.007525444030761719 time for calcul the mask position with numpy : 0.02486276626586914 nb_pixel_total : 24181 time to create 1 rle with old method : 0.027746200561523438 time for calcul the mask position with numpy : 0.025106191635131836 nb_pixel_total : 34542 time to create 1 rle with old method : 0.039594173431396484 time for calcul the mask position with numpy : 0.02413153648376465 nb_pixel_total : 13618 time to create 1 rle with old method : 0.015247106552124023 time for calcul the mask position with numpy : 0.02475142478942871 nb_pixel_total : 19338 time to create 1 rle with old method : 0.02156376838684082 time for calcul the mask position with numpy : 0.024438858032226562 nb_pixel_total : 7872 time to create 1 rle with old method : 0.009105443954467773 time for calcul the mask position with numpy : 0.024693965911865234 nb_pixel_total : 13873 time to create 1 rle with old method : 0.015996456146240234 time for calcul the mask position with numpy : 0.02442002296447754 nb_pixel_total : 48169 time to create 1 rle with old method : 0.05466938018798828 time for calcul the mask position with numpy : 0.02526378631591797 nb_pixel_total : 29586 time to create 1 rle with old method : 0.03326725959777832 time for calcul the mask position with numpy : 0.02564406394958496 nb_pixel_total : 90863 time to create 1 rle with old method : 0.10326480865478516 time for calcul the mask position with numpy : 0.0251004695892334 nb_pixel_total : 4695 time to create 1 rle with old method : 0.005181550979614258 time for calcul the mask position with numpy : 0.02398395538330078 nb_pixel_total : 94143 time to create 1 rle with old method : 0.10750651359558105 time for calcul the mask position with numpy : 0.02424478530883789 nb_pixel_total : 38839 time to create 1 rle with old method : 0.04418373107910156 time for calcul the mask position with numpy : 0.025568485260009766 nb_pixel_total : 115647 time to create 1 rle with old method : 0.13053154945373535 time for calcul the mask position with numpy : 0.02483224868774414 nb_pixel_total : 16412 time to create 1 rle with old method : 0.018890857696533203 time for calcul the mask position with numpy : 0.023904085159301758 nb_pixel_total : 14619 time to create 1 rle with old method : 0.01653313636779785 time for calcul the mask position with numpy : 0.02495408058166504 nb_pixel_total : 21086 time to create 1 rle with old method : 0.023629426956176758 create new chi : 2.9711039066314697 time to delete rle : 0.0014882087707519531 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11562 TO DO : save crop sub photo not yet done ! save time : 2.0341334342956543 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 9.89693307876587 time for calcul the mask position with numpy : 0.5945563316345215 nb_pixel_total : 7432910 time to create 1 rle with new method : 1.0674421787261963 time for calcul the mask position with numpy : 0.0244290828704834 nb_pixel_total : 17468 time to create 1 rle with old method : 0.020615100860595703 time for calcul the mask position with numpy : 0.025325298309326172 nb_pixel_total : 15031 time to create 1 rle with old method : 0.01782083511352539 time for calcul the mask position with numpy : 0.025823593139648438 nb_pixel_total : 51398 time to create 1 rle with old method : 0.06019449234008789 time for calcul the mask position with numpy : 0.02435755729675293 nb_pixel_total : 6114 time to create 1 rle with old method : 0.0071086883544921875 time for calcul the mask position with numpy : 0.023858070373535156 nb_pixel_total : 43218 time to create 1 rle with old method : 0.05000019073486328 time for calcul the mask position with numpy : 0.030638694763183594 nb_pixel_total : 78348 time to create 1 rle with old method : 0.08980870246887207 time for calcul the mask position with numpy : 0.032109737396240234 nb_pixel_total : 58822 time to create 1 rle with old method : 0.09236907958984375 time for calcul the mask position with numpy : 0.02787184715270996 nb_pixel_total : 257775 time to create 1 rle with new method : 0.8045449256896973 time for calcul the mask position with numpy : 0.024545669555664062 nb_pixel_total : 4904 time to create 1 rle with old method : 0.005891561508178711 time for calcul the mask position with numpy : 0.024033546447753906 nb_pixel_total : 34218 time to create 1 rle with old method : 0.03987717628479004 time for calcul the mask position with numpy : 0.025894641876220703 nb_pixel_total : 13596 time to create 1 rle with old method : 0.016248703002929688 time for calcul the mask position with numpy : 0.02871561050415039 nb_pixel_total : 32078 time to create 1 rle with old method : 0.03721451759338379 time for calcul the mask position with numpy : 0.025767087936401367 nb_pixel_total : 20991 time to create 1 rle with old method : 0.0250089168548584 time for calcul the mask position with numpy : 0.026033401489257812 nb_pixel_total : 24287 time to create 1 rle with old method : 0.028631925582885742 time for calcul the mask position with numpy : 0.02569437026977539 nb_pixel_total : 58716 time to create 1 rle with old method : 0.0680532455444336 time for calcul the mask position with numpy : 0.025974512100219727 nb_pixel_total : 22619 time to create 1 rle with old method : 0.0266265869140625 time for calcul the mask position with numpy : 0.025948286056518555 nb_pixel_total : 17734 time to create 1 rle with old method : 0.020783185958862305 time for calcul the mask position with numpy : 0.026568174362182617 nb_pixel_total : 22108 time to create 1 rle with old method : 0.02548837661743164 time for calcul the mask position with numpy : 0.024876832962036133 nb_pixel_total : 13351 time to create 1 rle with old method : 0.015548944473266602 time for calcul the mask position with numpy : 0.0251467227935791 nb_pixel_total : 39727 time to create 1 rle with old method : 0.0456085205078125 time for calcul the mask position with numpy : 0.02571725845336914 nb_pixel_total : 28987 time to create 1 rle with old method : 0.03329801559448242 create new chi : 3.81693434715271 time to delete rle : 0.0017936229705810547 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15796 TO DO : save crop sub photo not yet done ! save time : 1.444368839263916 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 9.141434907913208 time for calcul the mask position with numpy : 0.5745055675506592 nb_pixel_total : 7070563 time to create 1 rle with new method : 0.672316312789917 time for calcul the mask position with numpy : 0.02411508560180664 nb_pixel_total : 34533 time to create 1 rle with old method : 0.04009580612182617 time for calcul the mask position with numpy : 0.026327848434448242 nb_pixel_total : 85188 time to create 1 rle with old method : 0.09932494163513184 time for calcul the mask position with numpy : 0.04544520378112793 nb_pixel_total : 73852 time to create 1 rle with old method : 0.09860849380493164 time for calcul the mask position with numpy : 0.04331779479980469 nb_pixel_total : 22738 time to create 1 rle with old method : 0.02602362632751465 time for calcul the mask position with numpy : 0.04011058807373047 nb_pixel_total : 47898 time to create 1 rle with old method : 0.05543875694274902 time for calcul the mask position with numpy : 0.03465580940246582 nb_pixel_total : 32450 time to create 1 rle with old method : 0.037138938903808594 time for calcul the mask position with numpy : 0.025783300399780273 nb_pixel_total : 40804 time to create 1 rle with old method : 0.04645514488220215 time for calcul the mask position with numpy : 0.026721477508544922 nb_pixel_total : 62666 time to create 1 rle with old method : 0.07026004791259766 time for calcul the mask position with numpy : 0.025674104690551758 nb_pixel_total : 242420 time to create 1 rle with new method : 0.7435600757598877 time for calcul the mask position with numpy : 0.025154829025268555 nb_pixel_total : 21890 time to create 1 rle with old method : 0.0254671573638916 time for calcul the mask position with numpy : 0.024028301239013672 nb_pixel_total : 10193 time to create 1 rle with old method : 0.011777162551879883 time for calcul the mask position with numpy : 0.02480149269104004 nb_pixel_total : 89960 time to create 1 rle with old method : 0.10373926162719727 time for calcul the mask position with numpy : 0.02669239044189453 nb_pixel_total : 63392 time to create 1 rle with old method : 0.07837557792663574 time for calcul the mask position with numpy : 0.025594711303710938 nb_pixel_total : 33784 time to create 1 rle with old method : 0.038848876953125 time for calcul the mask position with numpy : 0.024519681930541992 nb_pixel_total : 7902 time to create 1 rle with old method : 0.009111642837524414 time for calcul the mask position with numpy : 0.024997949600219727 nb_pixel_total : 36161 time to create 1 rle with old method : 0.04242897033691406 time for calcul the mask position with numpy : 0.025858640670776367 nb_pixel_total : 26121 time to create 1 rle with old method : 0.03012537956237793 time for calcul the mask position with numpy : 0.02548074722290039 nb_pixel_total : 52913 time to create 1 rle with old method : 0.0612034797668457 time for calcul the mask position with numpy : 0.024853944778442383 nb_pixel_total : 39868 time to create 1 rle with old method : 0.045790672302246094 time for calcul the mask position with numpy : 0.024761199951171875 nb_pixel_total : 12519 time to create 1 rle with old method : 0.014520406723022461 time for calcul the mask position with numpy : 0.024991273880004883 nb_pixel_total : 101686 time to create 1 rle with old method : 0.11602520942687988 time for calcul the mask position with numpy : 0.025080442428588867 nb_pixel_total : 40702 time to create 1 rle with old method : 0.047272443771362305 time for calcul the mask position with numpy : 0.028682708740234375 nb_pixel_total : 44197 time to create 1 rle with old method : 0.06708407402038574 create new chi : 3.872037887573242 time to delete rle : 0.0020008087158203125 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 16149 TO DO : save crop sub photo not yet done ! save time : 1.7457280158996582 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.879910230636597 time for calcul the mask position with numpy : 0.4853658676147461 nb_pixel_total : 7031545 time to create 1 rle with new method : 0.8525748252868652 time for calcul the mask position with numpy : 0.024563074111938477 nb_pixel_total : 56872 time to create 1 rle with old method : 0.06598091125488281 time for calcul the mask position with numpy : 0.023823976516723633 nb_pixel_total : 21667 time to create 1 rle with old method : 0.025139331817626953 time for calcul the mask position with numpy : 0.023635387420654297 nb_pixel_total : 19082 time to create 1 rle with old method : 0.02198052406311035 time for calcul the mask position with numpy : 0.024775981903076172 nb_pixel_total : 59313 time to create 1 rle with old method : 0.06828188896179199 time for calcul the mask position with numpy : 0.024500608444213867 nb_pixel_total : 14548 time to create 1 rle with old method : 0.016903400421142578 time for calcul the mask position with numpy : 0.024633169174194336 nb_pixel_total : 8011 time to create 1 rle with old method : 0.00941920280456543 time for calcul the mask position with numpy : 0.02842092514038086 nb_pixel_total : 21838 time to create 1 rle with old method : 0.025102853775024414 time for calcul the mask position with numpy : 0.025301218032836914 nb_pixel_total : 57828 time to create 1 rle with old method : 0.06619858741760254 time for calcul the mask position with numpy : 0.025052785873413086 nb_pixel_total : 28542 time to create 1 rle with old method : 0.03281378746032715 time for calcul the mask position with numpy : 0.025864839553833008 nb_pixel_total : 139040 time to create 1 rle with old method : 0.157073974609375 time for calcul the mask position with numpy : 0.025056123733520508 nb_pixel_total : 23494 time to create 1 rle with old method : 0.02689194679260254 time for calcul the mask position with numpy : 0.025198698043823242 nb_pixel_total : 59798 time to create 1 rle with old method : 0.0705556869506836 time for calcul the mask position with numpy : 0.02472996711730957 nb_pixel_total : 77285 time to create 1 rle with old method : 0.08951401710510254 time for calcul the mask position with numpy : 0.025660991668701172 nb_pixel_total : 183029 time to create 1 rle with new method : 0.7530057430267334 time for calcul the mask position with numpy : 0.02502131462097168 nb_pixel_total : 14692 time to create 1 rle with old method : 0.016846895217895508 time for calcul the mask position with numpy : 0.02495288848876953 nb_pixel_total : 24367 time to create 1 rle with old method : 0.028206825256347656 time for calcul the mask position with numpy : 0.02555561065673828 nb_pixel_total : 213704 time to create 1 rle with new method : 0.7233214378356934 time for calcul the mask position with numpy : 0.024883270263671875 nb_pixel_total : 38659 time to create 1 rle with old method : 0.04440498352050781 time for calcul the mask position with numpy : 0.025558948516845703 nb_pixel_total : 88880 time to create 1 rle with old method : 0.10127115249633789 time for calcul the mask position with numpy : 0.025198936462402344 nb_pixel_total : 41692 time to create 1 rle with old method : 0.04808974266052246 time for calcul the mask position with numpy : 0.025296926498413086 nb_pixel_total : 70514 time to create 1 rle with old method : 0.07998037338256836 create new chi : 4.4285664558410645 time to delete rle : 0.0018756389617919922 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 15290 TO DO : save crop sub photo not yet done ! save time : 1.3061351776123047 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 7.126333475112915 time for calcul the mask position with numpy : 0.6616969108581543 nb_pixel_total : 7697387 time to create 1 rle with new method : 0.9884016513824463 time for calcul the mask position with numpy : 0.02723550796508789 nb_pixel_total : 30774 time to create 1 rle with old method : 0.044162750244140625 time for calcul the mask position with numpy : 0.0277101993560791 nb_pixel_total : 10301 time to create 1 rle with old method : 0.01751708984375 time for calcul the mask position with numpy : 0.026494741439819336 nb_pixel_total : 7897 time to create 1 rle with old method : 0.009327411651611328 time for calcul the mask position with numpy : 0.02525806427001953 nb_pixel_total : 17373 time to create 1 rle with old method : 0.020531654357910156 time for calcul the mask position with numpy : 0.0246584415435791 nb_pixel_total : 61701 time to create 1 rle with old method : 0.07140755653381348 time for calcul the mask position with numpy : 0.024919748306274414 nb_pixel_total : 30128 time to create 1 rle with old method : 0.03478217124938965 time for calcul the mask position with numpy : 0.02553844451904297 nb_pixel_total : 65911 time to create 1 rle with old method : 0.0762786865234375 time for calcul the mask position with numpy : 0.02572321891784668 nb_pixel_total : 137692 time to create 1 rle with old method : 0.15872621536254883 time for calcul the mask position with numpy : 0.02798938751220703 nb_pixel_total : 12299 time to create 1 rle with old method : 0.014505624771118164 time for calcul the mask position with numpy : 0.026105403900146484 nb_pixel_total : 115934 time to create 1 rle with old method : 0.13463616371154785 time for calcul the mask position with numpy : 0.025774717330932617 nb_pixel_total : 59412 time to create 1 rle with old method : 0.06877875328063965 time for calcul the mask position with numpy : 0.025315523147583008 nb_pixel_total : 10132 time to create 1 rle with old method : 0.012022018432617188 time for calcul the mask position with numpy : 0.025331974029541016 nb_pixel_total : 37459 time to create 1 rle with old method : 0.044118404388427734 create new chi : 2.740274429321289 time to delete rle : 0.0012307167053222656 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8864 TO DO : save crop sub photo not yet done ! save time : 1.264389991760254 map_output_result : {1373460825: (0.0, 'Should be the crop_list due to order', 0), 1373460816: (0.0, 'Should be the crop_list due to order', 0), 1373460815: (0.0, 'Should be the crop_list due to order', 0), 1373460813: (0.0, 'Should be the crop_list due to order', 0), 1373460810: (0.0, 'Should be the crop_list due to order', 0), 1373460786: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373460825, 1373460816, 1373460815, 1373460813, 1373460810, 1373460786] Looping around the photos to save general results len do output : 6 /1373460825.Didn't retrieve data . /1373460816.Didn't retrieve data . /1373460815.Didn't retrieve data . /1373460813.Didn't retrieve data . /1373460810.Didn't retrieve data . /1373460786.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460825', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460816', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460815', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460813', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460810', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460786', None, None, None, None, None, '3335247') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.04973936080932617 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.85189962387085 time spend to save output : 0.050072431564331055 total time spend for step 3 : 85.90197205543518 step4:ventilate_hashtags_in_portfolio Thu Jul 24 07:44:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25259010 get user id for portfolio 25259010 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','metal','papier','background','flou','pehd','mal_croppe','autre','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','metal','papier','background','flou','pehd','mal_croppe','autre','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','metal','papier','background','flou','pehd','mal_croppe','autre','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25259627,25259628,25259629,25259630,25259631,25259632,25259633,25259634,25259635,25259636,25259637?tags=pet_fonce,carton,metal,papier,background,flou,pehd,mal_croppe,autre,pet_clair,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373460825, 1373460816, 1373460815, 1373460813, 1373460810, 1373460786] Looping around the photos to save general results len do output : 1 /25259010. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460825', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460816', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460815', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460813', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460810', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460786', None, None, None, None, None, '3335247') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.06269049644470215 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.1800808906555176 time spend to save output : 0.06296086311340332 total time spend for step 4 : 2.243041753768921 step5:final Thu Jul 24 07:44:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373460825: ('0.10505730774176954',), 1373460816: ('0.10505730774176954',), 1373460815: ('0.10505730774176954',), 1373460813: ('0.10505730774176954',), 1373460810: ('0.10505730774176954',), 1373460786: ('0.10505730774176954',)} new output for save of step final : {1373460825: ('0.10505730774176954',), 1373460816: ('0.10505730774176954',), 1373460815: ('0.10505730774176954',), 1373460813: ('0.10505730774176954',), 1373460810: ('0.10505730774176954',), 1373460786: ('0.10505730774176954',)} [1373460825, 1373460816, 1373460815, 1373460813, 1373460810, 1373460786] Looping around the photos to save general results len do output : 6 /1373460825.Didn't retrieve data . /1373460816.Didn't retrieve data . /1373460815.Didn't retrieve data . /1373460813.Didn't retrieve data . /1373460810.Didn't retrieve data . /1373460786.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460825', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460816', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460815', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460813', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460810', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460786', None, None, None, None, None, '3335247') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.05163145065307617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1611919403076172 time spend to save output : 0.05214381217956543 total time spend for step 5 : 0.21333575248718262 step6:blur_detection Thu Jul 24 07:44:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae.jpg resize: (2160, 3840) 1373460825 -7.82343486183739 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715.jpg resize: (2160, 3840) 1373460816 -7.861862340813379 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d.jpg resize: (2160, 3840) 1373460815 -7.761563793608851 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d.jpg resize: (2160, 3840) 1373460813 -7.591776574984104 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87.jpg resize: (2160, 3840) 1373460810 -7.6728547204018565 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab.jpg resize: (2160, 3840) 1373460786 -7.125014773844878 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185105_0.png resize: (259, 183) 1373468252 -3.5165454263150138 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185113_0.png resize: (134, 116) 1373468254 -4.586115698553645 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185106_0.png resize: (308, 214) 1373468255 -5.386117446937161 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185098_0.png resize: (258, 185) 1373468256 0.2743733228779282 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185104_0.png resize: (212, 387) 1373468258 -4.1005418310941435 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185101_0.png resize: (146, 183) 1373468259 -0.6681410151928227 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185099_0.png resize: (128, 163) 1373468260 -5.0647135015417275 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185111_0.png resize: (159, 182) 1373468262 -2.0349676611149916 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185108_0.png resize: (308, 265) 1373468263 -4.061079452563733 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185097_0.png resize: (319, 375) 1373468264 -2.383985095558461 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185103_0.png resize: (397, 334) 1373468265 -5.409725358834739 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185107_0.png resize: (271, 170) 1373468267 -4.887031015729433 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185110_0.png resize: (193, 230) 1373468268 -4.743587177221387 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185112_0.png resize: (144, 129) 1373468270 -3.6803714883679923 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185114_0.png resize: (226, 167) 1373468271 -0.05031579823413864 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185131_0.png resize: (141, 181) 1373468272 0.5872371156902141 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185124_0.png resize: (128, 165) 1373468274 -5.0453330815222985 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185127_0.png resize: (140, 138) 1373468275 -3.6077185645611274 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185129_0.png resize: (258, 153) 1373468276 -2.6084162497201775 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185132_0.png resize: (178, 221) 1373468278 -4.954858792923865 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185116_0.png resize: (201, 113) 1373468280 -2.0603866474124812 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185118_0.png resize: (272, 188) 1373468282 0.3098251292731236 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185123_0.png resize: (353, 173) 1373468284 -4.817873007224403 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185128_0.png resize: (237, 245) 1373468285 -3.4789169613595265 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185126_0.png resize: (125, 332) 1373468286 -3.781285317959609 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185117_0.png resize: (486, 446) 1373468287 -4.959820772508565 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185130_0.png resize: (81, 121) 1373468289 -4.0736381806718605 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185120_0.png resize: (110, 71) 1373468290 -2.7911330292894845 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185125_0.png resize: (102, 118) 1373468291 -4.059440001176854 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185122_0.png resize: (354, 214) 1373468293 -4.017724137796637 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185121_0.png resize: (522, 236) 1373468294 -4.984883209559641 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185134_0.png resize: (255, 261) 1373468295 -1.9677925548193334 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185139_0.png resize: (456, 230) 1373468297 -4.90147333748143 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185146_0.png resize: (692, 577) 1373468298 -5.147108004257527 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185140_0.png resize: (279, 148) 1373468299 -4.604117952287984 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185137_0.png resize: (160, 161) 1373468301 -2.1037311880812775 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185149_0.png resize: (222, 535) 1373468302 -3.647190348100797 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185148_0.png resize: (412, 321) 1373468305 -4.788814081975876 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185143_0.png resize: (157, 225) 1373468306 -4.43279216510485 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185153_0.png resize: (234, 330) 1373468307 -3.206767389990362 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185151_0.png resize: (426, 228) 1373468309 -3.5282435517764905 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185142_0.png resize: (168, 276) 1373468310 -3.7661336475024325 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185144_0.png resize: (238, 229) 1373468311 -4.719174279913266 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185135_0.png resize: (118, 197) 1373468312 -3.981139496423167 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185147_0.png resize: (254, 335) 1373468313 -4.398567937327221 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185133_0.png resize: (216, 173) 1373468314 -0.8126124274830208 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185141_0.png resize: (317, 312) 1373468315 -4.06575949603153 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185136_0.png resize: (175, 204) 1373468316 -3.819410031466726 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185145_0.png resize: (282, 253) 1373468317 -1.2506808122132254 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185138_0.png resize: (236, 238) 1373468318 -4.630359809254023 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185152_0.png resize: (316, 69) 1373468319 -3.581593063519387 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185155_0.png resize: (386, 141) 1373468320 -4.271330119336725 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185168_0.png resize: (792, 450) 1373468321 -5.548331512258121 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185169_0.png resize: (300, 292) 1373468322 -4.430756445661207 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185167_0.png resize: (160, 179) 1373468323 -5.122199554588072 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185172_0.png resize: (413, 334) 1373468324 -4.857308304348921 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185157_0.png resize: (197, 107) 1373468325 -2.5178209860401783 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185175_0.png resize: (245, 451) 1373468326 -5.2274994628697575 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185161_0.png resize: (227, 250) 1373468327 -4.294707406945777 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185156_0.png resize: (384, 393) 1373468328 -3.7062579577108328 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185174_0.png resize: (339, 372) 1373468329 -4.127768884531378 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185158_0.png resize: (211, 217) 1373468330 -3.9768392925295544 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185160_0.png resize: (372, 114) 1373468331 -4.571625433599206 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185163_0.png resize: (191, 315) 1373468332 -0.6447526095131263 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185173_0.png resize: (177, 177) 1373468333 -4.669826330320316 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185164_0.png resize: (392, 353) 1373468334 -3.9111793717500696 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185171_0.png resize: (245, 225) 1373468335 -5.221043715730381 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185154_0.png resize: (240, 278) 1373468336 0.8463938550839153 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185166_0.png resize: (113, 112) 1373468337 -4.260653002381884 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185170_0.png resize: (357, 184) 1373468338 -4.985568130748145 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185159_0.png resize: (216, 355) 1373468339 -3.8578190406929216 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185162_0.png resize: (158, 65) 1373468340 -3.9135778387129174 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185181_0.png resize: (528, 558) 1373468341 -5.5282519928076255 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185180_0.png resize: (181, 308) 1373468342 -4.036032384152272 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185179_0.png resize: (264, 517) 1373468343 -4.049443795865714 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185190_0.png resize: (340, 269) 1373468344 -5.205472811243657 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185187_0.png resize: (219, 179) 1373468345 -4.042488854823514 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185197_0.png resize: (350, 226) 1373468346 -4.904415583281222 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185177_0.png resize: (290, 358) 1373468347 -2.840598325693517 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185193_0.png resize: (117, 162) 1373468348 -3.1975670638385068 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185185_0.png resize: (352, 354) 1373468349 -4.897175311229628 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185178_0.png resize: (232, 341) 1373468350 -1.3014904375083778 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185186_0.png resize: (412, 193) 1373468351 -5.445076994949117 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185189_0.png resize: (192, 198) 1373468352 -2.204513530143244 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185182_0.png resize: (256, 139) 1373468353 -4.654729623311294 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185191_0.png resize: (228, 120) 1373468354 -4.888427288928412 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185192_0.png resize: (108, 96) 1373468355 -4.213989226125716 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185202_0.png resize: (93, 208) 1373468356 -5.407037086454091 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185209_0.png resize: (148, 77) 1373468357 -3.5317143097621964 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185200_0.png resize: (231, 405) 1373468358 -5.075094145452301 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185203_0.png resize: (374, 484) 1373468359 -5.966483016192828 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185210_0.png resize: (377, 190) 1373468360 -4.17265065058785 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185201_0.png resize: (380, 405) 1373468361 -5.138533125699885 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185207_0.png resize: (150, 228) 1373468362 -4.261457481139441 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185205_0.png resize: (216, 215) 1373468363 -4.417091766120933 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185208_0.png resize: (166, 103) 1373468364 -3.796472918463815 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185204_0.png resize: (360, 285) 1373468365 -3.609150190664474 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185100_0.png resize: (136, 93) 1373468373 -4.106659906367416 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185115_0.png resize: (173, 124) 1373468375 -5.096636223312917 treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185150_0.png resize: (149, 106) 1373468376 -4.234142419375994 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185176_0.png resize: (235, 208) 1373468377 -4.5547412827261065 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185183_0.png resize: (106, 187) 1373468378 -3.8913027552563464 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185184_0.png resize: (742, 624) 1373468379 -3.909641719763589 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185198_0.png resize: (189, 293) 1373468380 -5.101246857080081 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185206_0.png resize: (254, 380) 1373468381 -4.756945368004707 treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185199_0.png resize: (126, 110) 1373468382 -2.0725456298897638 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185109_0.png resize: (544, 208) 1373468390 -3.222997306283709 treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185102_0.png resize: (288, 538) 1373468391 -5.671703639781002 treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185119_0.png resize: (565, 216) 1373468392 -3.4127230974728024 treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185165_0.png resize: (293, 407) 1373468393 -5.365194440820466 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185194_0.png resize: (267, 273) 1373468394 -5.617318365504382 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185188_0.png resize: (409, 430) 1373468395 -5.298836860032623 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185195_0.png resize: (259, 132) 1373468396 -4.984168947413493 treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185196_0.png resize: (165, 156) 1373468399 -1.1757655226342234 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 120 time used for this insertion : 0.028153419494628906 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 120 time used for this insertion : 0.3051753044128418 save missing photos in datou_result : time spend for datou_step_exec : 28.17148208618164 time spend to save output : 0.3387610912322998 total time spend for step 6 : 28.51024317741394 step7:brightness Thu Jul 24 07:44:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae.jpg treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715.jpg treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d.jpg treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d.jpg treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87.jpg treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab.jpg treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185105_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185113_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185106_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185098_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185104_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185101_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185099_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185111_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185108_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185097_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185103_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185107_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185110_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185112_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185114_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185131_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185124_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185127_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185129_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185132_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185116_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185118_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185123_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185128_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185126_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185117_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185130_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185120_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185125_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185122_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185121_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185134_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185139_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185146_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185140_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185137_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185149_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185148_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185143_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185153_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185151_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185142_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185144_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185135_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185147_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185133_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185141_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185136_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185145_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185138_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185152_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185155_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185168_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185169_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185167_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185172_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185157_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185175_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185161_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185156_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185174_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185158_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185160_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185163_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185173_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185164_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185171_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185154_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185166_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185170_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185159_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185162_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185181_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185180_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185179_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185190_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185187_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185197_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185177_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185193_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185185_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185178_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185186_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185189_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185182_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185191_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185192_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185202_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185209_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185200_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185203_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185210_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185201_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185207_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185205_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185208_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185204_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185100_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185115_0.png treat image : temp/1753335629_694946_1373460815_9f6b6c4d2b9edfddbecce1bbb8f4582d_rle_crop_3892185150_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185176_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185183_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185184_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185198_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185206_0.png treat image : temp/1753335629_694946_1373460786_fec1a7778f25e7a9e54142a6bcb77eab_rle_crop_3892185199_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185109_0.png treat image : temp/1753335629_694946_1373460825_340cf4654041b5ffc72899d4034322ae_rle_crop_3892185102_0.png treat image : temp/1753335629_694946_1373460816_22ec7f5950473728a216fa4440a58715_rle_crop_3892185119_0.png treat image : temp/1753335629_694946_1373460813_a5c2fba2602422595cf50e0d6187954d_rle_crop_3892185165_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185194_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185188_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185195_0.png treat image : temp/1753335629_694946_1373460810_77902ad1732528c7adecc27fda998b87_rle_crop_3892185196_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 120 time used for this insertion : 0.03722858428955078 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 120 time used for this insertion : 0.6128339767456055 save missing photos in datou_result : time spend for datou_step_exec : 6.268286228179932 time spend to save output : 0.6558208465576172 total time spend for step 7 : 6.924107074737549 step8:velours_tree Thu Jul 24 07:44:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13697314262390137 time spend to save output : 5.2928924560546875e-05 total time spend for step 8 : 0.13702607154846191 step9:send_mail_cod Thu Jul 24 07:44:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25259010_24-07-2025_07_44_45.pdf 25259627 imagette252596271753335885 25259628 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252596281753335885 25259629 imagette252596291753335886 25259630 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252596301753335886 25259631 imagette252596311753335888 25259632 imagette252596321753335888 25259633 imagette252596331753335888 25259634 imagette252596341753335888 25259635 change filename to text .imagette252596351753335888 25259636 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252596361753335888 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25259010 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25259627,25259628,25259629,25259630,25259631,25259632,25259633,25259634,25259635,25259636,25259637?tags=pet_fonce,carton,metal,papier,background,flou,pehd,mal_croppe,autre,pet_clair,environnement args[1373460825] : ((1373460825, -7.82343486183739, 492609224), (1373460825, 0.7410641392172058, 2107752395), '0.10505730774176954') We are sending mail with results at report@fotonower.com args[1373460816] : ((1373460816, -7.861862340813379, 492609224), (1373460816, 0.7360531277471294, 2107752395), '0.10505730774176954') We are sending mail with results at report@fotonower.com args[1373460815] : ((1373460815, -7.761563793608851, 492609224), (1373460815, 0.8577821073582516, 2107752395), '0.10505730774176954') We are sending mail with results at report@fotonower.com args[1373460813] : ((1373460813, -7.591776574984104, 492609224), (1373460813, 0.48487608104730295, 2107752395), '0.10505730774176954') We are sending mail with results at report@fotonower.com args[1373460810] : ((1373460810, -7.6728547204018565, 492609224), (1373460810, 0.5211848866028054, 2107752395), '0.10505730774176954') We are sending mail with results at report@fotonower.com args[1373460786] : ((1373460786, -7.125014773844878, 492609224), (1373460786, -0.000627849192187827, 2107752395), '0.10505730774176954') We are sending mail with results at report@fotonower.com refus_total : 0.10505730774176954 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25259010 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf results_Auto_P25259010_24-07-2025_07_44_45.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25259010','results_Auto_P25259010_24-07-2025_07_44_45.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf','pdf','','0.51','0.10505730774176954') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25259010

https://www.fotonower.com/image?json=false&list_photos_id=1373460825
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373460816
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373460815
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373460813
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373460810
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373460786
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.51%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25259628?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25259630?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25259635?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25259636?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf.

Lien vers velours :https://www.fotonower.com/velours/25259627,25259628,25259629,25259630,25259631,25259632,25259633,25259634,25259635,25259636,25259637?tags=pet_fonce,carton,metal,papier,background,flou,pehd,mal_croppe,autre,pet_clair,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Jul 2025 05:44:51 GMT Content-Length: 0 Connection: close X-Message-Id: SAFSeRCxT6i1QYdeE9XPKA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373460825, 1373460816, 1373460815, 1373460813, 1373460810, 1373460786] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460825', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460816', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460815', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460813', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460810', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460786', None, None, None, None, None, '3335247') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.029139041900634766 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.507408380508423 time spend to save output : 0.029361963272094727 total time spend for step 9 : 5.536770343780518 step10:split_time_score Thu Jul 24 07:44:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('06', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24072025 25259010 Nombre de photos uploadées : 6 / 23040 (0%) 24072025 25259010 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 24072025 25259010 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.0531158447265625e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.000278472900390625 elapsed_time : insert_dashboard_record_day_entry 0.03220415115356445 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03791742956327484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25257554_24-07-2025_07_23_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25257554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25257554 AND mptpi.`type`=3726 To do Qualite : 0.10505730774176954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25259010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24072025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373460825, 1373460816, 1373460815, 1373460813, 1373460810, 1373460786] Looping around the photos to save general results len do output : 1 /25259010Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460825', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460816', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460815', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460813', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460810', None, None, None, None, None, '3335247') ('3318', None, None, None, None, None, None, None, '3335247') ('3318', '25259010', '1373460786', None, None, None, None, None, '3335247') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.027257442474365234 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.36943984031677246 time spend to save output : 0.027436256408691406 total time spend for step 10 : 0.39687609672546387 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 108.59user 101.62system 4:27.14elapsed 78%CPU (0avgtext+0avgdata 5063656maxresident)k 645072inputs+101744outputs (8013major+10821220minor)pagefaults 0swaps