python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1416408 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3461963'] with mtr_portfolio_ids : ['25733340'] and first list_photo_ids : [] new path : /proc/1416408/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.4977807998657227 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 6 16:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10580 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-06 16:10:34.811240: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-06 16:10:34.839334: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-06 16:10:34.841484: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4064000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-06 16:10:34.841517: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-06 16:10:34.846778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-06 16:10:34.990030: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x91c14b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-06 16:10:34.990081: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-06 16:10:34.990887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 16:10:34.991255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 16:10:34.993793: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 16:10:34.996443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 16:10:34.996774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 16:10:34.999450: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 16:10:35.000975: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 16:10:35.006503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 16:10:35.008060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 16:10:35.008151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 16:10:35.008948: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-06 16:10:35.008963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-06 16:10:35.008972: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-06 16:10:35.010290: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9803 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-06 16:10:35.300116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 16:10:35.300253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 16:10:35.300279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 16:10:35.300301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 16:10:35.300322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 16:10:35.300343: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 16:10:35.300363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 16:10:35.300383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 16:10:35.301922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 16:10:35.303375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 16:10:35.303417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 16:10:35.303435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 16:10:35.303453: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 16:10:35.303469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 16:10:35.303487: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 16:10:35.303504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 16:10:35.303521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 16:10:35.304878: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 16:10:35.304914: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-06 16:10:35.304922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-06 16:10:35.304930: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-06 16:10:35.306296: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9803 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-06 16:10:48.022166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 16:10:48.216519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 1417106 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1667 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10733 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0015974044799804688 nb_pixel_total : 46814 time to create 1 rle with old method : 0.052376747131347656 length of segment : 307 time for calcul the mask position with numpy : 0.001373291015625 nb_pixel_total : 70491 time to create 1 rle with old method : 0.07697844505310059 length of segment : 228 time for calcul the mask position with numpy : 0.0010287761688232422 nb_pixel_total : 60869 time to create 1 rle with old method : 0.06860160827636719 length of segment : 386 time for calcul the mask position with numpy : 0.0003604888916015625 nb_pixel_total : 22777 time to create 1 rle with old method : 0.02594137191772461 length of segment : 190 time for calcul the mask position with numpy : 0.0011959075927734375 nb_pixel_total : 63517 time to create 1 rle with old method : 0.07924604415893555 length of segment : 229 time for calcul the mask position with numpy : 0.0019083023071289062 nb_pixel_total : 66178 time to create 1 rle with old method : 0.08823204040527344 length of segment : 346 time for calcul the mask position with numpy : 0.016973495483398438 nb_pixel_total : 357030 time to create 1 rle with new method : 0.04420948028564453 length of segment : 1346 time for calcul the mask position with numpy : 0.005440473556518555 nb_pixel_total : 200554 time to create 1 rle with new method : 0.013857841491699219 length of segment : 611 time for calcul the mask position with numpy : 0.0006716251373291016 nb_pixel_total : 51488 time to create 1 rle with old method : 0.060471534729003906 length of segment : 224 time for calcul the mask position with numpy : 0.0008254051208496094 nb_pixel_total : 37119 time to create 1 rle with old method : 0.04019498825073242 length of segment : 396 time for calcul the mask position with numpy : 0.0009970664978027344 nb_pixel_total : 52614 time to create 1 rle with old method : 0.060883522033691406 length of segment : 180 time for calcul the mask position with numpy : 0.001894235610961914 nb_pixel_total : 40591 time to create 1 rle with old method : 0.04607558250427246 length of segment : 552 time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 29118 time to create 1 rle with old method : 0.0323333740234375 length of segment : 201 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 15255 time to create 1 rle with old method : 0.017436504364013672 length of segment : 146 time for calcul the mask position with numpy : 0.000484466552734375 nb_pixel_total : 27238 time to create 1 rle with old method : 0.03025531768798828 length of segment : 384 time for calcul the mask position with numpy : 0.0007071495056152344 nb_pixel_total : 25073 time to create 1 rle with old method : 0.026541948318481445 length of segment : 331 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 39217 time to create 1 rle with old method : 0.04274177551269531 length of segment : 292 time for calcul the mask position with numpy : 0.000881195068359375 nb_pixel_total : 45992 time to create 1 rle with old method : 0.05213046073913574 length of segment : 351 time for calcul the mask position with numpy : 0.0015285015106201172 nb_pixel_total : 78577 time to create 1 rle with old method : 0.09050869941711426 length of segment : 528 time for calcul the mask position with numpy : 0.001833200454711914 nb_pixel_total : 94151 time to create 1 rle with old method : 0.10398030281066895 length of segment : 376 time for calcul the mask position with numpy : 0.0022230148315429688 nb_pixel_total : 50539 time to create 1 rle with old method : 0.05495786666870117 length of segment : 305 time for calcul the mask position with numpy : 0.0012257099151611328 nb_pixel_total : 25826 time to create 1 rle with old method : 0.033551931381225586 length of segment : 123 time for calcul the mask position with numpy : 0.0013048648834228516 nb_pixel_total : 25725 time to create 1 rle with old method : 0.029381275177001953 length of segment : 195 time for calcul the mask position with numpy : 0.003014087677001953 nb_pixel_total : 71736 time to create 1 rle with old method : 0.07909536361694336 length of segment : 371 time for calcul the mask position with numpy : 0.0006620883941650391 nb_pixel_total : 15339 time to create 1 rle with old method : 0.017354488372802734 length of segment : 176 time for calcul the mask position with numpy : 0.001026153564453125 nb_pixel_total : 18330 time to create 1 rle with old method : 0.021270036697387695 length of segment : 173 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 7061 time to create 1 rle with old method : 0.008314132690429688 length of segment : 89 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 6112 time to create 1 rle with old method : 0.007154226303100586 length of segment : 83 time for calcul the mask position with numpy : 0.0015268325805664062 nb_pixel_total : 31586 time to create 1 rle with old method : 0.036362409591674805 length of segment : 231 time for calcul the mask position with numpy : 0.001569509506225586 nb_pixel_total : 37010 time to create 1 rle with old method : 0.0414273738861084 length of segment : 205 time for calcul the mask position with numpy : 0.00041031837463378906 nb_pixel_total : 6372 time to create 1 rle with old method : 0.007581472396850586 length of segment : 92 time for calcul the mask position with numpy : 0.0015583038330078125 nb_pixel_total : 27541 time to create 1 rle with old method : 0.03159523010253906 length of segment : 278 time for calcul the mask position with numpy : 0.0005040168762207031 nb_pixel_total : 10851 time to create 1 rle with old method : 0.012366771697998047 length of segment : 132 time for calcul the mask position with numpy : 0.013553619384765625 nb_pixel_total : 345834 time to create 1 rle with new method : 0.02745676040649414 length of segment : 676 time for calcul the mask position with numpy : 0.0023581981658935547 nb_pixel_total : 44621 time to create 1 rle with old method : 0.049102783203125 length of segment : 369 time for calcul the mask position with numpy : 0.001115560531616211 nb_pixel_total : 25880 time to create 1 rle with old method : 0.028966188430786133 length of segment : 201 time for calcul the mask position with numpy : 0.00038361549377441406 nb_pixel_total : 8361 time to create 1 rle with old method : 0.010647058486938477 length of segment : 93 time for calcul the mask position with numpy : 0.0037932395935058594 nb_pixel_total : 102279 time to create 1 rle with old method : 0.11664295196533203 length of segment : 454 time for calcul the mask position with numpy : 0.002309560775756836 nb_pixel_total : 35300 time to create 1 rle with old method : 0.040853023529052734 length of segment : 343 time for calcul the mask position with numpy : 0.0013356208801269531 nb_pixel_total : 31665 time to create 1 rle with old method : 0.03531074523925781 length of segment : 264 time for calcul the mask position with numpy : 0.0005269050598144531 nb_pixel_total : 17635 time to create 1 rle with old method : 0.02000737190246582 length of segment : 163 time for calcul the mask position with numpy : 0.001291513442993164 nb_pixel_total : 31288 time to create 1 rle with old method : 0.03474020957946777 length of segment : 166 time for calcul the mask position with numpy : 0.0008237361907958984 nb_pixel_total : 17427 time to create 1 rle with old method : 0.020270586013793945 length of segment : 291 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 22180 time to create 1 rle with old method : 0.025133848190307617 length of segment : 210 time for calcul the mask position with numpy : 0.010926485061645508 nb_pixel_total : 369857 time to create 1 rle with new method : 0.036583662033081055 length of segment : 763 time for calcul the mask position with numpy : 0.0014603137969970703 nb_pixel_total : 45272 time to create 1 rle with old method : 0.04845857620239258 length of segment : 339 time for calcul the mask position with numpy : 0.008592367172241211 nb_pixel_total : 192418 time to create 1 rle with new method : 0.02712702751159668 length of segment : 724 time for calcul the mask position with numpy : 0.0010209083557128906 nb_pixel_total : 25734 time to create 1 rle with old method : 0.028491735458374023 length of segment : 250 time for calcul the mask position with numpy : 0.002397775650024414 nb_pixel_total : 82416 time to create 1 rle with old method : 0.09367132186889648 length of segment : 343 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 17610 time to create 1 rle with old method : 0.020216703414916992 length of segment : 186 time for calcul the mask position with numpy : 0.0005528926849365234 nb_pixel_total : 7482 time to create 1 rle with old method : 0.009221076965332031 length of segment : 160 time for calcul the mask position with numpy : 0.0024230480194091797 nb_pixel_total : 61371 time to create 1 rle with old method : 0.07065153121948242 length of segment : 353 time for calcul the mask position with numpy : 0.0015826225280761719 nb_pixel_total : 34202 time to create 1 rle with old method : 0.04042625427246094 length of segment : 285 time for calcul the mask position with numpy : 0.0016088485717773438 nb_pixel_total : 37828 time to create 1 rle with old method : 0.043398141860961914 length of segment : 490 time for calcul the mask position with numpy : 0.0014421939849853516 nb_pixel_total : 33473 time to create 1 rle with old method : 0.037575721740722656 length of segment : 317 time for calcul the mask position with numpy : 0.004106044769287109 nb_pixel_total : 91146 time to create 1 rle with old method : 0.10510706901550293 length of segment : 627 time for calcul the mask position with numpy : 0.004203319549560547 nb_pixel_total : 118960 time to create 1 rle with old method : 0.14635229110717773 length of segment : 364 time for calcul the mask position with numpy : 0.0023317337036132812 nb_pixel_total : 72903 time to create 1 rle with old method : 0.0830240249633789 length of segment : 308 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 21422 time to create 1 rle with old method : 0.02584218978881836 length of segment : 222 time for calcul the mask position with numpy : 0.0020728111267089844 nb_pixel_total : 42009 time to create 1 rle with old method : 0.04860639572143555 length of segment : 525 time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 24946 time to create 1 rle with old method : 0.028489351272583008 length of segment : 170 time for calcul the mask position with numpy : 0.0015559196472167969 nb_pixel_total : 71105 time to create 1 rle with old method : 0.0858314037322998 length of segment : 250 time for calcul the mask position with numpy : 0.0016024112701416016 nb_pixel_total : 58225 time to create 1 rle with old method : 0.0670006275177002 length of segment : 177 time for calcul the mask position with numpy : 0.004597187042236328 nb_pixel_total : 133106 time to create 1 rle with old method : 0.15207147598266602 length of segment : 597 time for calcul the mask position with numpy : 0.0033159255981445312 nb_pixel_total : 76910 time to create 1 rle with old method : 0.09029698371887207 length of segment : 722 time for calcul the mask position with numpy : 0.001726388931274414 nb_pixel_total : 29430 time to create 1 rle with old method : 0.03769636154174805 length of segment : 263 time for calcul the mask position with numpy : 0.0029926300048828125 nb_pixel_total : 55968 time to create 1 rle with old method : 0.06266522407531738 length of segment : 309 time for calcul the mask position with numpy : 0.00140380859375 nb_pixel_total : 29607 time to create 1 rle with old method : 0.038132667541503906 length of segment : 241 time for calcul the mask position with numpy : 0.004955768585205078 nb_pixel_total : 111513 time to create 1 rle with old method : 0.13245868682861328 length of segment : 682 time for calcul the mask position with numpy : 0.0028569698333740234 nb_pixel_total : 52940 time to create 1 rle with old method : 0.0813283920288086 length of segment : 265 time for calcul the mask position with numpy : 0.0019407272338867188 nb_pixel_total : 45905 time to create 1 rle with old method : 0.05219745635986328 length of segment : 504 time for calcul the mask position with numpy : 0.00594782829284668 nb_pixel_total : 185334 time to create 1 rle with new method : 0.01089334487915039 length of segment : 747 time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 9669 time to create 1 rle with old method : 0.010709047317504883 length of segment : 83 time for calcul the mask position with numpy : 0.0009593963623046875 nb_pixel_total : 19664 time to create 1 rle with old method : 0.022037506103515625 length of segment : 205 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 10979 time to create 1 rle with old method : 0.012716293334960938 length of segment : 211 time for calcul the mask position with numpy : 0.0017402172088623047 nb_pixel_total : 52491 time to create 1 rle with old method : 0.06007266044616699 length of segment : 353 time for calcul the mask position with numpy : 0.006348133087158203 nb_pixel_total : 185233 time to create 1 rle with new method : 0.013818740844726562 length of segment : 442 time for calcul the mask position with numpy : 0.0006182193756103516 nb_pixel_total : 14592 time to create 1 rle with old method : 0.016815662384033203 length of segment : 207 time for calcul the mask position with numpy : 0.0037348270416259766 nb_pixel_total : 99773 time to create 1 rle with old method : 0.1120157241821289 length of segment : 543 time for calcul the mask position with numpy : 0.005110025405883789 nb_pixel_total : 150982 time to create 1 rle with new method : 0.010735034942626953 length of segment : 436 time for calcul the mask position with numpy : 0.003718852996826172 nb_pixel_total : 114414 time to create 1 rle with old method : 0.1238250732421875 length of segment : 733 time for calcul the mask position with numpy : 0.0013484954833984375 nb_pixel_total : 41889 time to create 1 rle with old method : 0.04740595817565918 length of segment : 248 time for calcul the mask position with numpy : 0.003968000411987305 nb_pixel_total : 78971 time to create 1 rle with old method : 0.0927591323852539 length of segment : 282 time for calcul the mask position with numpy : 0.00225067138671875 nb_pixel_total : 37146 time to create 1 rle with old method : 0.041939735412597656 length of segment : 565 time for calcul the mask position with numpy : 0.001325845718383789 nb_pixel_total : 36464 time to create 1 rle with old method : 0.0403599739074707 length of segment : 431 time for calcul the mask position with numpy : 0.004771709442138672 nb_pixel_total : 158693 time to create 1 rle with new method : 0.006611824035644531 length of segment : 377 time for calcul the mask position with numpy : 0.001130819320678711 nb_pixel_total : 22915 time to create 1 rle with old method : 0.02576422691345215 length of segment : 242 time for calcul the mask position with numpy : 0.0013968944549560547 nb_pixel_total : 39749 time to create 1 rle with old method : 0.04496264457702637 length of segment : 254 time for calcul the mask position with numpy : 0.0007100105285644531 nb_pixel_total : 22465 time to create 1 rle with old method : 0.025933027267456055 length of segment : 221 time for calcul the mask position with numpy : 0.0021834373474121094 nb_pixel_total : 44529 time to create 1 rle with old method : 0.04962968826293945 length of segment : 497 time for calcul the mask position with numpy : 0.004923105239868164 nb_pixel_total : 117435 time to create 1 rle with old method : 0.13079214096069336 length of segment : 485 time for calcul the mask position with numpy : 0.0016202926635742188 nb_pixel_total : 28206 time to create 1 rle with old method : 0.032041072845458984 length of segment : 403 time for calcul the mask position with numpy : 0.0008373260498046875 nb_pixel_total : 10628 time to create 1 rle with old method : 0.011822938919067383 length of segment : 189 time for calcul the mask position with numpy : 0.0040662288665771484 nb_pixel_total : 105288 time to create 1 rle with old method : 0.11678814888000488 length of segment : 712 time for calcul the mask position with numpy : 0.002223968505859375 nb_pixel_total : 75047 time to create 1 rle with old method : 0.0942375659942627 length of segment : 224 time for calcul the mask position with numpy : 0.003962039947509766 nb_pixel_total : 76030 time to create 1 rle with old method : 0.08603477478027344 length of segment : 428 time for calcul the mask position with numpy : 0.0012049674987792969 nb_pixel_total : 42640 time to create 1 rle with old method : 0.04819989204406738 length of segment : 218 time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 12817 time to create 1 rle with old method : 0.015641450881958008 length of segment : 89 time for calcul the mask position with numpy : 0.0012760162353515625 nb_pixel_total : 20098 time to create 1 rle with old method : 0.02386474609375 length of segment : 255 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 13109 time to create 1 rle with old method : 0.015084981918334961 length of segment : 234 time for calcul the mask position with numpy : 0.0005459785461425781 nb_pixel_total : 11417 time to create 1 rle with old method : 0.0132293701171875 length of segment : 140 time for calcul the mask position with numpy : 0.003244161605834961 nb_pixel_total : 60686 time to create 1 rle with old method : 0.06751632690429688 length of segment : 403 time for calcul the mask position with numpy : 0.0005307197570800781 nb_pixel_total : 11517 time to create 1 rle with old method : 0.012966632843017578 length of segment : 143 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 12155 time to create 1 rle with old method : 0.01382589340209961 length of segment : 153 time for calcul the mask position with numpy : 0.0005071163177490234 nb_pixel_total : 12982 time to create 1 rle with old method : 0.014805078506469727 length of segment : 129 time for calcul the mask position with numpy : 0.0007467269897460938 nb_pixel_total : 24593 time to create 1 rle with old method : 0.02809286117553711 length of segment : 201 time for calcul the mask position with numpy : 0.0018770694732666016 nb_pixel_total : 71979 time to create 1 rle with old method : 0.08092045783996582 length of segment : 204 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 14172 time to create 1 rle with old method : 0.024512290954589844 length of segment : 87 time for calcul the mask position with numpy : 0.0006585121154785156 nb_pixel_total : 11533 time to create 1 rle with old method : 0.01828742027282715 length of segment : 147 time for calcul the mask position with numpy : 0.007866382598876953 nb_pixel_total : 209245 time to create 1 rle with new method : 0.023168325424194336 length of segment : 565 time for calcul the mask position with numpy : 0.005892753601074219 nb_pixel_total : 173849 time to create 1 rle with new method : 0.01296234130859375 length of segment : 716 time for calcul the mask position with numpy : 0.0012097358703613281 nb_pixel_total : 40087 time to create 1 rle with old method : 0.04517960548400879 length of segment : 342 time for calcul the mask position with numpy : 0.0007343292236328125 nb_pixel_total : 26454 time to create 1 rle with old method : 0.02992725372314453 length of segment : 240 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 7972 time to create 1 rle with old method : 0.009233713150024414 length of segment : 191 time for calcul the mask position with numpy : 0.0015745162963867188 nb_pixel_total : 49869 time to create 1 rle with old method : 0.05435967445373535 length of segment : 404 time for calcul the mask position with numpy : 0.00039649009704589844 nb_pixel_total : 11257 time to create 1 rle with old method : 0.012832403182983398 length of segment : 114 time for calcul the mask position with numpy : 0.0011401176452636719 nb_pixel_total : 35763 time to create 1 rle with old method : 0.04091334342956543 length of segment : 200 time for calcul the mask position with numpy : 0.000255584716796875 nb_pixel_total : 15783 time to create 1 rle with old method : 0.017487287521362305 length of segment : 119 time for calcul the mask position with numpy : 0.0008289813995361328 nb_pixel_total : 20251 time to create 1 rle with old method : 0.02245187759399414 length of segment : 241 time for calcul the mask position with numpy : 0.0012135505676269531 nb_pixel_total : 38686 time to create 1 rle with old method : 0.041928768157958984 length of segment : 350 time for calcul the mask position with numpy : 0.0005083084106445312 nb_pixel_total : 22682 time to create 1 rle with old method : 0.026015043258666992 length of segment : 166 time for calcul the mask position with numpy : 0.0002772808074951172 nb_pixel_total : 6182 time to create 1 rle with old method : 0.007020711898803711 length of segment : 99 time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 15935 time to create 1 rle with old method : 0.01890277862548828 length of segment : 161 time spent for convertir_results : 12.366138219833374 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 123 chid ids of type : 3594 Number RLEs to save : 39552 save missing photos in datou_result : time spend for datou_step_exec : 72.48372006416321 time spend to save output : 2.343761682510376 total time spend for step 1 : 74.82748174667358 step2:crop_condition Wed Aug 6 16:11:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 123 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 105 About to insert : list_path_to_insert length 105 new photo from crops ! About to upload 105 photos upload in portfolio : 3736932 init cache_photo without model_param we have 105 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754489537_1416408 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 105 photos in the portfolio 3736932 time of upload the photos Elapsed time : 24.264896869659424 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754489565_1416408 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3115530014038086 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754489571_1416408 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3198821544647217 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754489573_1416408 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.597057580947876 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375486337, 1375486271, 1375486204, 1375486202, 1375486200, 1375486198, 1375486194] Looping around the photos to save general results len do output : 123 /1375495811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375495968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486337', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486271', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486204', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486202', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486200', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486198', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486194', None, None, None, None, None, '3461963') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 376 time used for this insertion : 0.03438115119934082 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.35121965408325 time spend to save output : 0.03883647918701172 total time spend for step 2 : 67.39005613327026 step3:rle_unique_nms_with_priority Wed Aug 6 16:12:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 123 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 5.359896898269653 time for calcul the mask position with numpy : 0.7256054878234863 nb_pixel_total : 7361601 time to create 1 rle with new method : 1.1101863384246826 time for calcul the mask position with numpy : 0.025507688522338867 nb_pixel_total : 51488 time to create 1 rle with old method : 0.056175947189331055 time for calcul the mask position with numpy : 0.026437044143676758 nb_pixel_total : 200554 time to create 1 rle with new method : 1.1296229362487793 time for calcul the mask position with numpy : 0.037050485610961914 nb_pixel_total : 350111 time to create 1 rle with new method : 0.6957919597625732 time for calcul the mask position with numpy : 0.027349233627319336 nb_pixel_total : 66178 time to create 1 rle with old method : 0.07301139831542969 time for calcul the mask position with numpy : 0.02764725685119629 nb_pixel_total : 63517 time to create 1 rle with old method : 0.0704336166381836 time for calcul the mask position with numpy : 0.025143146514892578 nb_pixel_total : 22777 time to create 1 rle with old method : 0.024698495864868164 time for calcul the mask position with numpy : 0.025820255279541016 nb_pixel_total : 60869 time to create 1 rle with old method : 0.06565165519714355 time for calcul the mask position with numpy : 0.025606632232666016 nb_pixel_total : 70491 time to create 1 rle with old method : 0.08052444458007812 time for calcul the mask position with numpy : 0.02651357650756836 nb_pixel_total : 46814 time to create 1 rle with old method : 0.051241159439086914 create new chi : 4.425776243209839 time to delete rle : 0.02593708038330078 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9646 TO DO : save crop sub photo not yet done ! save time : 0.613452672958374 nb_obj : 26 nb_hashtags : 4 time to prepare the origin masks : 4.371638774871826 time for calcul the mask position with numpy : 0.7204945087432861 nb_pixel_total : 7105247 time to create 1 rle with new method : 0.9011321067810059 time for calcul the mask position with numpy : 0.033748626708984375 nb_pixel_total : 31586 time to create 1 rle with old method : 0.03690910339355469 time for calcul the mask position with numpy : 0.034417152404785156 nb_pixel_total : 44621 time to create 1 rle with old method : 0.05012178421020508 time for calcul the mask position with numpy : 0.035651445388793945 nb_pixel_total : 37119 time to create 1 rle with old method : 0.041405677795410156 time for calcul the mask position with numpy : 0.034060001373291016 nb_pixel_total : 2066 time to create 1 rle with old method : 0.0023903846740722656 time for calcul the mask position with numpy : 0.03471040725708008 nb_pixel_total : 27238 time to create 1 rle with old method : 0.030143022537231445 time for calcul the mask position with numpy : 0.03474235534667969 nb_pixel_total : 50539 time to create 1 rle with old method : 0.06055808067321777 time for calcul the mask position with numpy : 0.03514432907104492 nb_pixel_total : 71736 time to create 1 rle with old method : 0.08010244369506836 time for calcul the mask position with numpy : 0.034006357192993164 nb_pixel_total : 15255 time to create 1 rle with old method : 0.016962051391601562 time for calcul the mask position with numpy : 0.033083200454711914 nb_pixel_total : 27541 time to create 1 rle with old method : 0.03127241134643555 time for calcul the mask position with numpy : 0.03482866287231445 nb_pixel_total : 45992 time to create 1 rle with old method : 0.0492098331451416 time for calcul the mask position with numpy : 0.03275251388549805 nb_pixel_total : 25725 time to create 1 rle with old method : 0.027327537536621094 time for calcul the mask position with numpy : 0.03239727020263672 nb_pixel_total : 10851 time to create 1 rle with old method : 0.01151895523071289 time for calcul the mask position with numpy : 0.03282427787780762 nb_pixel_total : 40591 time to create 1 rle with old method : 0.06167483329772949 time for calcul the mask position with numpy : 0.038477182388305664 nb_pixel_total : 37010 time to create 1 rle with old method : 0.041524648666381836 time for calcul the mask position with numpy : 0.03892874717712402 nb_pixel_total : 345834 time to create 1 rle with new method : 1.170342206954956 time for calcul the mask position with numpy : 0.033776283264160156 nb_pixel_total : 39217 time to create 1 rle with old method : 0.04257059097290039 time for calcul the mask position with numpy : 0.03409099578857422 nb_pixel_total : 29118 time to create 1 rle with old method : 0.030978918075561523 time for calcul the mask position with numpy : 0.033190011978149414 nb_pixel_total : 78577 time to create 1 rle with old method : 0.08297038078308105 time for calcul the mask position with numpy : 0.03252291679382324 nb_pixel_total : 18330 time to create 1 rle with old method : 0.01976609230041504 time for calcul the mask position with numpy : 0.03420090675354004 nb_pixel_total : 94151 time to create 1 rle with old method : 0.10090208053588867 time for calcul the mask position with numpy : 0.03315019607543945 nb_pixel_total : 25073 time to create 1 rle with old method : 0.027123212814331055 time for calcul the mask position with numpy : 0.03309273719787598 nb_pixel_total : 25826 time to create 1 rle with old method : 0.027518510818481445 time for calcul the mask position with numpy : 0.03315997123718262 nb_pixel_total : 6372 time to create 1 rle with old method : 0.006750822067260742 time for calcul the mask position with numpy : 0.03378438949584961 nb_pixel_total : 52614 time to create 1 rle with old method : 0.059525251388549805 time for calcul the mask position with numpy : 0.033568620681762695 nb_pixel_total : 6111 time to create 1 rle with old method : 0.006430387496948242 time for calcul the mask position with numpy : 0.03255581855773926 nb_pixel_total : 60 time to create 1 rle with old method : 8.559226989746094e-05 create new chi : 4.6902055740356445 time to delete rle : 0.002149820327758789 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 16244 TO DO : save crop sub photo not yet done ! save time : 0.9323368072509766 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 9.273693084716797 time for calcul the mask position with numpy : 1.081932544708252 nb_pixel_total : 7286537 time to create 1 rle with new method : 1.4601249694824219 time for calcul the mask position with numpy : 0.04167604446411133 nb_pixel_total : 34202 time to create 1 rle with old method : 0.03814291954040527 time for calcul the mask position with numpy : 0.042217254638671875 nb_pixel_total : 61371 time to create 1 rle with old method : 0.06784629821777344 time for calcul the mask position with numpy : 0.04118657112121582 nb_pixel_total : 7482 time to create 1 rle with old method : 0.008432865142822266 time for calcul the mask position with numpy : 0.04031062126159668 nb_pixel_total : 17610 time to create 1 rle with old method : 0.02124309539794922 time for calcul the mask position with numpy : 0.03657388687133789 nb_pixel_total : 82416 time to create 1 rle with old method : 0.12325167655944824 time for calcul the mask position with numpy : 0.027716875076293945 nb_pixel_total : 25734 time to create 1 rle with old method : 0.028620004653930664 time for calcul the mask position with numpy : 0.027483701705932617 nb_pixel_total : 192418 time to create 1 rle with new method : 0.8916873931884766 time for calcul the mask position with numpy : 0.0367734432220459 nb_pixel_total : 45272 time to create 1 rle with old method : 0.05729103088378906 time for calcul the mask position with numpy : 0.032578229904174805 nb_pixel_total : 275953 time to create 1 rle with new method : 0.921377420425415 time for calcul the mask position with numpy : 0.025937318801879883 nb_pixel_total : 22180 time to create 1 rle with old method : 0.024201393127441406 time for calcul the mask position with numpy : 0.028473377227783203 nb_pixel_total : 17427 time to create 1 rle with old method : 0.01954817771911621 time for calcul the mask position with numpy : 0.03945660591125488 nb_pixel_total : 4678 time to create 1 rle with old method : 0.005503654479980469 time for calcul the mask position with numpy : 0.03741574287414551 nb_pixel_total : 17635 time to create 1 rle with old method : 0.019588947296142578 time for calcul the mask position with numpy : 0.03705573081970215 nb_pixel_total : 31665 time to create 1 rle with old method : 0.03442692756652832 time for calcul the mask position with numpy : 0.038031578063964844 nb_pixel_total : 35300 time to create 1 rle with old method : 0.03948259353637695 time for calcul the mask position with numpy : 0.03836393356323242 nb_pixel_total : 102279 time to create 1 rle with old method : 0.11005949974060059 time for calcul the mask position with numpy : 0.03495597839355469 nb_pixel_total : 8361 time to create 1 rle with old method : 0.009528875350952148 time for calcul the mask position with numpy : 0.036286115646362305 nb_pixel_total : 25880 time to create 1 rle with old method : 0.029878854751586914 create new chi : 5.7375993728637695 time to delete rle : 0.0025014877319335938 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13038 TO DO : save crop sub photo not yet done ! save time : 0.7985477447509766 nb_obj : 22 nb_hashtags : 2 time to prepare the origin masks : 10.597199440002441 time for calcul the mask position with numpy : 0.7671775817871094 nb_pixel_total : 6961385 time to create 1 rle with new method : 1.535487413406372 time for calcul the mask position with numpy : 0.04181528091430664 nb_pixel_total : 10979 time to create 1 rle with old method : 0.012282609939575195 time for calcul the mask position with numpy : 0.034173011779785156 nb_pixel_total : 19664 time to create 1 rle with old method : 0.021773815155029297 time for calcul the mask position with numpy : 0.029630184173583984 nb_pixel_total : 9669 time to create 1 rle with old method : 0.010846853256225586 time for calcul the mask position with numpy : 0.02942371368408203 nb_pixel_total : 185334 time to create 1 rle with new method : 1.2460346221923828 time for calcul the mask position with numpy : 0.026628971099853516 nb_pixel_total : 45905 time to create 1 rle with old method : 0.04981732368469238 time for calcul the mask position with numpy : 0.025547027587890625 nb_pixel_total : 52940 time to create 1 rle with old method : 0.05672907829284668 time for calcul the mask position with numpy : 0.026031494140625 nb_pixel_total : 111513 time to create 1 rle with old method : 0.12142276763916016 time for calcul the mask position with numpy : 0.024037837982177734 nb_pixel_total : 29607 time to create 1 rle with old method : 0.03202223777770996 time for calcul the mask position with numpy : 0.025957345962524414 nb_pixel_total : 55968 time to create 1 rle with old method : 0.06042599678039551 time for calcul the mask position with numpy : 0.024829864501953125 nb_pixel_total : 29430 time to create 1 rle with old method : 0.03196287155151367 time for calcul the mask position with numpy : 0.024950742721557617 nb_pixel_total : 76883 time to create 1 rle with old method : 0.08144092559814453 time for calcul the mask position with numpy : 0.02610492706298828 nb_pixel_total : 133106 time to create 1 rle with old method : 0.14166569709777832 time for calcul the mask position with numpy : 0.02684926986694336 nb_pixel_total : 58225 time to create 1 rle with old method : 0.06213665008544922 time for calcul the mask position with numpy : 0.027050495147705078 nb_pixel_total : 71105 time to create 1 rle with old method : 0.07734060287475586 time for calcul the mask position with numpy : 0.026966094970703125 nb_pixel_total : 24946 time to create 1 rle with old method : 0.025958538055419922 time for calcul the mask position with numpy : 0.02526545524597168 nb_pixel_total : 42009 time to create 1 rle with old method : 0.044594764709472656 time for calcul the mask position with numpy : 0.0253293514251709 nb_pixel_total : 21422 time to create 1 rle with old method : 0.02270221710205078 time for calcul the mask position with numpy : 0.02617049217224121 nb_pixel_total : 72903 time to create 1 rle with old method : 0.07852482795715332 time for calcul the mask position with numpy : 0.02878880500793457 nb_pixel_total : 118960 time to create 1 rle with old method : 0.12943720817565918 time for calcul the mask position with numpy : 0.02861189842224121 nb_pixel_total : 91146 time to create 1 rle with old method : 0.1001431941986084 time for calcul the mask position with numpy : 0.026384353637695312 nb_pixel_total : 33473 time to create 1 rle with old method : 0.03634142875671387 time for calcul the mask position with numpy : 0.026479721069335938 nb_pixel_total : 37828 time to create 1 rle with old method : 0.044162750244140625 create new chi : 5.469297885894775 time to delete rle : 0.002350330352783203 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18700 TO DO : save crop sub photo not yet done ! save time : 1.0680575370788574 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 11.562433242797852 time for calcul the mask position with numpy : 1.158585548400879 nb_pixel_total : 7042231 time to create 1 rle with new method : 1.8606688976287842 time for calcul the mask position with numpy : 0.038689613342285156 nb_pixel_total : 8851 time to create 1 rle with old method : 0.010259151458740234 time for calcul the mask position with numpy : 0.025560379028320312 nb_pixel_total : 10628 time to create 1 rle with old method : 0.011867523193359375 time for calcul the mask position with numpy : 0.025902271270751953 nb_pixel_total : 28206 time to create 1 rle with old method : 0.03101038932800293 time for calcul the mask position with numpy : 0.026003360748291016 nb_pixel_total : 117435 time to create 1 rle with old method : 0.12732791900634766 time for calcul the mask position with numpy : 0.025522232055664062 nb_pixel_total : 44529 time to create 1 rle with old method : 0.048330068588256836 time for calcul the mask position with numpy : 0.028650760650634766 nb_pixel_total : 22465 time to create 1 rle with old method : 0.024438142776489258 time for calcul the mask position with numpy : 0.0283355712890625 nb_pixel_total : 39749 time to create 1 rle with old method : 0.04423689842224121 time for calcul the mask position with numpy : 0.028430700302124023 nb_pixel_total : 22915 time to create 1 rle with old method : 0.025455951690673828 time for calcul the mask position with numpy : 0.028718233108520508 nb_pixel_total : 158693 time to create 1 rle with new method : 0.5735015869140625 time for calcul the mask position with numpy : 0.02680373191833496 nb_pixel_total : 36464 time to create 1 rle with old method : 0.04088926315307617 time for calcul the mask position with numpy : 0.030196666717529297 nb_pixel_total : 23889 time to create 1 rle with old method : 0.02699565887451172 time for calcul the mask position with numpy : 0.03016805648803711 nb_pixel_total : 78971 time to create 1 rle with old method : 0.08763933181762695 time for calcul the mask position with numpy : 0.027150630950927734 nb_pixel_total : 41889 time to create 1 rle with old method : 0.0468134880065918 time for calcul the mask position with numpy : 0.02733612060546875 nb_pixel_total : 114414 time to create 1 rle with old method : 0.12644338607788086 time for calcul the mask position with numpy : 0.0263826847076416 nb_pixel_total : 150982 time to create 1 rle with new method : 1.072016954421997 time for calcul the mask position with numpy : 0.024970531463623047 nb_pixel_total : 99773 time to create 1 rle with old method : 0.10985541343688965 time for calcul the mask position with numpy : 0.025629520416259766 nb_pixel_total : 14592 time to create 1 rle with old method : 0.01607203483581543 time for calcul the mask position with numpy : 0.026534318923950195 nb_pixel_total : 185233 time to create 1 rle with new method : 1.3530364036560059 time for calcul the mask position with numpy : 0.0284879207611084 nb_pixel_total : 52491 time to create 1 rle with old method : 0.06058812141418457 create new chi : 7.513280153274536 time to delete rle : 0.0038242340087890625 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 16161 TO DO : save crop sub photo not yet done ! save time : 0.981248140335083 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 6.284501314163208 time for calcul the mask position with numpy : 1.8107199668884277 nb_pixel_total : 7921430 time to create 1 rle with new method : 1.77182936668396 time for calcul the mask position with numpy : 0.02565765380859375 nb_pixel_total : 24593 time to create 1 rle with old method : 0.027495384216308594 time for calcul the mask position with numpy : 0.02955770492553711 nb_pixel_total : 12982 time to create 1 rle with old method : 0.018634319305419922 time for calcul the mask position with numpy : 0.02481842041015625 nb_pixel_total : 12034 time to create 1 rle with old method : 0.013242483139038086 time for calcul the mask position with numpy : 0.025195598602294922 nb_pixel_total : 11517 time to create 1 rle with old method : 0.012646675109863281 time for calcul the mask position with numpy : 0.02394580841064453 nb_pixel_total : 60686 time to create 1 rle with old method : 0.0640859603881836 time for calcul the mask position with numpy : 0.025423049926757812 nb_pixel_total : 11417 time to create 1 rle with old method : 0.018875837326049805 time for calcul the mask position with numpy : 0.028272151947021484 nb_pixel_total : 13109 time to create 1 rle with old method : 0.021718502044677734 time for calcul the mask position with numpy : 0.02577066421508789 nb_pixel_total : 20098 time to create 1 rle with old method : 0.022366762161254883 time for calcul the mask position with numpy : 0.024496793746948242 nb_pixel_total : 12817 time to create 1 rle with old method : 0.014190673828125 time for calcul the mask position with numpy : 0.02532029151916504 nb_pixel_total : 42640 time to create 1 rle with old method : 0.04614448547363281 time for calcul the mask position with numpy : 0.024924755096435547 nb_pixel_total : 76030 time to create 1 rle with old method : 0.08382749557495117 time for calcul the mask position with numpy : 0.025624752044677734 nb_pixel_total : 75047 time to create 1 rle with old method : 0.08239197731018066 create new chi : 4.361369609832764 time to delete rle : 0.0010066032409667969 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7357 TO DO : save crop sub photo not yet done ! save time : 0.44907379150390625 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 9.587632656097412 time for calcul the mask position with numpy : 0.4880404472351074 nb_pixel_total : 7536256 time to create 1 rle with new method : 0.9791755676269531 time for calcul the mask position with numpy : 0.06032991409301758 nb_pixel_total : 15935 time to create 1 rle with old method : 0.017961740493774414 time for calcul the mask position with numpy : 0.026010751724243164 nb_pixel_total : 6182 time to create 1 rle with old method : 0.0070323944091796875 time for calcul the mask position with numpy : 0.02601003646850586 nb_pixel_total : 22488 time to create 1 rle with old method : 0.025037765502929688 time for calcul the mask position with numpy : 0.024996280670166016 nb_pixel_total : 38686 time to create 1 rle with old method : 0.04280829429626465 time for calcul the mask position with numpy : 0.02483844757080078 nb_pixel_total : 20251 time to create 1 rle with old method : 0.022329092025756836 time for calcul the mask position with numpy : 0.025428295135498047 nb_pixel_total : 15427 time to create 1 rle with old method : 0.01715993881225586 time for calcul the mask position with numpy : 0.025185108184814453 nb_pixel_total : 35763 time to create 1 rle with old method : 0.03945493698120117 time for calcul the mask position with numpy : 0.02888798713684082 nb_pixel_total : 11257 time to create 1 rle with old method : 0.012597799301147461 time for calcul the mask position with numpy : 0.041123151779174805 nb_pixel_total : 49869 time to create 1 rle with old method : 0.055074453353881836 time for calcul the mask position with numpy : 0.03977632522583008 nb_pixel_total : 7972 time to create 1 rle with old method : 0.008910894393920898 time for calcul the mask position with numpy : 0.04022383689880371 nb_pixel_total : 26454 time to create 1 rle with old method : 0.029511213302612305 time for calcul the mask position with numpy : 0.04038548469543457 nb_pixel_total : 27082 time to create 1 rle with old method : 0.030053377151489258 time for calcul the mask position with numpy : 0.04187607765197754 nb_pixel_total : 173849 time to create 1 rle with new method : 0.7949504852294922 time for calcul the mask position with numpy : 0.03728890419006348 nb_pixel_total : 209245 time to create 1 rle with new method : 0.7850837707519531 time for calcul the mask position with numpy : 0.0316159725189209 nb_pixel_total : 11533 time to create 1 rle with old method : 0.012807607650756836 time for calcul the mask position with numpy : 0.03222036361694336 nb_pixel_total : 14172 time to create 1 rle with old method : 0.0156857967376709 time for calcul the mask position with numpy : 0.031143665313720703 nb_pixel_total : 71979 time to create 1 rle with old method : 0.07875299453735352 create new chi : 4.155582904815674 time to delete rle : 0.0016450881958007812 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10787 TO DO : save crop sub photo not yet done ! save time : 0.6462223529815674 map_output_result : {1375486337: (0.0, 'Should be the crop_list due to order', 0), 1375486271: (0.0, 'Should be the crop_list due to order', 0), 1375486204: (0.0, 'Should be the crop_list due to order', 0), 1375486202: (0.0, 'Should be the crop_list due to order', 0), 1375486200: (0.0, 'Should be the crop_list due to order', 0), 1375486198: (0.0, 'Should be the crop_list due to order', 0), 1375486194: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375486337, 1375486271, 1375486204, 1375486202, 1375486200, 1375486198, 1375486194] Looping around the photos to save general results len do output : 7 /1375486337.Didn't retrieve data . /1375486271.Didn't retrieve data . /1375486204.Didn't retrieve data . /1375486202.Didn't retrieve data . /1375486200.Didn't retrieve data . /1375486198.Didn't retrieve data . /1375486194.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486337', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486271', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486204', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486202', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486200', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486198', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486194', None, None, None, None, None, '3461963') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.015431880950927734 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.13976263999939 time spend to save output : 0.01673102378845215 total time spend for step 3 : 100.15649366378784 step4:ventilate_hashtags_in_portfolio Wed Aug 6 16:14:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25733340 get user id for portfolio 25733340 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25733340 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','flou','pehd','mal_croppe','pet_fonce','papier','metal','environnement','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25733340 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','flou','pehd','mal_croppe','pet_fonce','papier','metal','environnement','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25733340 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','flou','pehd','mal_croppe','pet_fonce','papier','metal','environnement','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25733743,25733744,25733745,25733746,25733747,25733748,25733750,25733751,25733752,25733753,25733754?tags=background,carton,flou,pehd,mal_croppe,pet_fonce,papier,metal,environnement,autre,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375486337, 1375486271, 1375486204, 1375486202, 1375486200, 1375486198, 1375486194] Looping around the photos to save general results len do output : 1 /25733340. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486337', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486271', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486204', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486202', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486200', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486198', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486194', None, None, None, None, None, '3461963') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014842033386230469 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7976648807525635 time spend to save output : 0.015051841735839844 total time spend for step 4 : 0.8127167224884033 step5:final Wed Aug 6 16:14:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375486337: ('0.11791282586529983',), 1375486271: ('0.11791282586529983',), 1375486204: ('0.11791282586529983',), 1375486202: ('0.11791282586529983',), 1375486200: ('0.11791282586529983',), 1375486198: ('0.11791282586529983',), 1375486194: ('0.11791282586529983',)} new output for save of step final : {1375486337: ('0.11791282586529983',), 1375486271: ('0.11791282586529983',), 1375486204: ('0.11791282586529983',), 1375486202: ('0.11791282586529983',), 1375486200: ('0.11791282586529983',), 1375486198: ('0.11791282586529983',), 1375486194: ('0.11791282586529983',)} [1375486337, 1375486271, 1375486204, 1375486202, 1375486200, 1375486198, 1375486194] Looping around the photos to save general results len do output : 7 /1375486337.Didn't retrieve data . /1375486271.Didn't retrieve data . /1375486204.Didn't retrieve data . /1375486202.Didn't retrieve data . /1375486200.Didn't retrieve data . /1375486198.Didn't retrieve data . /1375486194.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486337', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486271', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486204', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486202', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486200', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486198', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486194', None, None, None, None, None, '3461963') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013916969299316406 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13800907135009766 time spend to save output : 0.014384746551513672 total time spend for step 5 : 0.15239381790161133 step6:blur_detection Wed Aug 6 16:14:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd.jpg resize: (2160, 3840) 1375486337 -5.883850363720725 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3.jpg resize: (2160, 3840) 1375486271 -7.1565835217979545 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd.jpg resize: (2160, 3840) 1375486204 -7.574601907532937 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec.jpg resize: (2160, 3840) 1375486202 -7.184124318888652 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d.jpg resize: (2160, 3840) 1375486200 -7.155197090132963 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c.jpg resize: (2160, 3840) 1375486198 -6.257007826220379 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a.jpg resize: (2160, 3840) 1375486194 -6.202037405009162 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908244_0.png resize: (186, 151) 1375495811 -3.225048397310574 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908242_0.png resize: (225, 345) 1375495812 1.278424779333588 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908248_0.png resize: (504, 678) 1375495813 -3.904054778810914 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908241_0.png resize: (307, 243) 1375495814 -3.7687997685165735 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908243_0.png resize: (334, 370) 1375495815 -3.817811932044875 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908247_0.png resize: (953, 719) 1375495816 -5.1392721224401425 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908246_0.png resize: (342, 357) 1375495817 -4.322004389544278 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908259_0.png resize: (507, 222) 1375495818 -2.6508960744096717 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908257_0.png resize: (246, 199) 1375495819 -3.230059252925764 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908274_0.png resize: (643, 713) 1375495820 -5.909651552751223 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908263_0.png resize: (189, 214) 1375495821 -4.139831462708587 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908256_0.png resize: (331, 182) 1375495822 -3.6184716981857146 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908250_0.png resize: (395, 153) 1375495823 -1.817442998497074 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908260_0.png resize: (334, 442) 1375495824 -2.838982726883316 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908266_0.png resize: (167, 195) 1375495825 -4.3397888365613655 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908268_0.png resize: (81, 92) 1375495826 -4.322442766294993 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908253_0.png resize: (199, 216) 1375495827 -0.6733260431154412 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908251_0.png resize: (145, 523) 1375495828 -3.5828152879376853 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908258_0.png resize: (351, 183) 1375495829 -1.798257918869255 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908252_0.png resize: (447, 305) 1375495830 -3.565645038356566 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908262_0.png resize: (122, 288) 1375495831 -4.6251651582974525 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908267_0.png resize: (88, 100) 1375495832 -2.3726715515013064 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908255_0.png resize: (248, 165) 1375495833 -0.5920815971430746 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908265_0.png resize: (125, 170) 1375495834 -4.288765368686807 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908254_0.png resize: (139, 205) 1375495835 -3.310327011321438 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908273_0.png resize: (130, 129) 1375495836 -2.976686399433292 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908269_0.png resize: (193, 307) 1375495837 -1.999840684745169 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908271_0.png resize: (92, 115) 1375495838 -4.048278767960728 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908264_0.png resize: (360, 345) 1375495839 -4.766575576230184 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908261_0.png resize: (283, 258) 1375495840 -4.550032646655702 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908280_0.png resize: (253, 178) 1375495841 -3.4700685732447423 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908277_0.png resize: (92, 115) 1375495842 -2.290857852440959 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908283_0.png resize: (282, 90) 1375495843 -2.636724536216436 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908279_0.png resize: (338, 206) 1375495844 -4.1126299308638785 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908288_0.png resize: (239, 179) 1375495845 -2.719440058917068 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908276_0.png resize: (189, 207) 1375495846 -1.6754100792025155 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908287_0.png resize: (492, 847) 1375495847 -1.4057434711965313 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908293_0.png resize: (213, 246) 1375495848 -3.7885436557667513 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908291_0.png resize: (160, 85) 1375495849 -3.3283154032697713 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908286_0.png resize: (332, 222) 1375495850 0.838111088327392 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908285_0.png resize: (718, 733) 1375495851 -5.3973135654074635 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908282_0.png resize: (149, 312) 1375495852 -1.0920998300420572 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908278_0.png resize: (355, 447) 1375495853 -2.778009786028303 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908311_0.png resize: (376, 188) 1375495854 -1.5275620704088684 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908303_0.png resize: (176, 390) 1375495855 -3.9211271764092266 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908297_0.png resize: (355, 471) 1375495856 -1.1076943558491856 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908301_0.png resize: (170, 221) 1375495857 -4.057658887593677 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908304_0.png resize: (483, 479) 1375495858 -3.9335626219249513 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908309_0.png resize: (406, 435) 1375495859 -4.110905975923562 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908306_0.png resize: (241, 188) 1375495860 -3.715948632315779 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908298_0.png resize: (307, 350) 1375495862 -2.6354676257914544 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908302_0.png resize: (219, 377) 1375495863 -4.591844764842888 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908295_0.png resize: (302, 187) 1375495864 -4.007501037070662 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908299_0.png resize: (219, 169) 1375495865 -1.2272604490413974 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908296_0.png resize: (617, 225) 1375495866 -3.595073000834804 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908314_0.png resize: (205, 152) 1375495867 -4.3656045319088275 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908315_0.png resize: (222, 99) 1375495868 -4.282415782049753 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908310_0.png resize: (200, 394) 1375495869 -3.7592084029875967 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908305_0.png resize: (401, 375) 1375495870 -4.401496617374563 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908294_0.png resize: (397, 165) 1375495871 -1.751589214546551 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908313_0.png resize: (80, 156) 1375495872 0.5760163061832936 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908300_0.png resize: (473, 163) 1375495873 -4.135536243294999 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908312_0.png resize: (571, 463) 1375495875 -5.624833653753115 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908323_0.png resize: (240, 538) 1375495877 -3.6224454423968324 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908328_0.png resize: (243, 233) 1375495879 -2.842997455634643 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908317_0.png resize: (342, 766) 1375495880 -0.7700986317670268 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908325_0.png resize: (326, 181) 1375495881 -4.013166488080016 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908319_0.png resize: (543, 328) 1375495882 -4.638730933662146 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908329_0.png resize: (194, 186) 1375495884 -2.973514533514652 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908324_0.png resize: (469, 173) 1375495885 -4.437186259631465 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908322_0.png resize: (225, 295) 1375495886 -0.575421356483795 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908318_0.png resize: (206, 116) 1375495887 -4.059562891132167 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908316_0.png resize: (279, 321) 1375495888 -4.1916732171460565 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908320_0.png resize: (344, 658) 1375495889 -1.3753790915599562 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908326_0.png resize: (358, 683) 1375495890 -4.19590498919145 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908331_0.png resize: (485, 500) 1375495891 -3.824395567093556 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908332_0.png resize: (252, 290) 1375495892 -3.8283894826232236 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908333_0.png resize: (139, 198) 1375495893 -4.053433772327264 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908334_0.png resize: (560, 341) 1375495894 -4.480089446634533 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908335_0.png resize: (224, 513) 1375495895 -1.3061747402613793 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908337_0.png resize: (216, 206) 1375495896 0.39992912841150724 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908341_0.png resize: (140, 115) 1375495897 -3.902335422081442 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908345_0.png resize: (129, 152) 1375495898 -4.42411946797654 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908344_0.png resize: (151, 105) 1375495899 1.3412854350907029 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908336_0.png resize: (428, 536) 1375495900 -2.7408133558487693 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908342_0.png resize: (397, 279) 1375495901 -3.971533993942369 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908343_0.png resize: (143, 120) 1375495902 -2.031181760391632 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908346_0.png resize: (188, 189) 1375495903 -4.266332814525617 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908339_0.png resize: (252, 123) 1375495904 -3.5876403509501467 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908340_0.png resize: (234, 77) 1375495905 -4.084675505823292 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908347_0.png resize: (202, 514) 1375495906 -1.261817872804912 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908362_0.png resize: (98, 70) 1375495907 -3.599290411096284 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908348_0.png resize: (82, 191) 1375495908 0.37611024243422564 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908356_0.png resize: (114, 131) 1375495909 -4.421181613070392 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908361_0.png resize: (156, 205) 1375495910 -3.0692859437665323 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908350_0.png resize: (555, 682) 1375495911 -3.1590443318545334 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908352_0.png resize: (315, 360) 1375495912 -1.9049452189123588 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908360_0.png resize: (350, 181) 1375495913 -3.790560196074593 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908349_0.png resize: (147, 127) 1375495914 -1.9306909548125097 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908351_0.png resize: (496, 732) 1375495915 -4.15205841137163 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908358_0.png resize: (119, 173) 1375495916 -1.6774157983764426 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908353_0.png resize: (239, 185) 1375495917 0.4891048743146931 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908359_0.png resize: (239, 121) 1375495918 -3.6943199464216554 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908354_0.png resize: (162, 73) 1375495919 -3.235373621295216 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908355_0.png resize: (398, 199) 1375495920 -4.117645851373718 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908245_0.png resize: (215, 459) 1375495937 -4.442511700819936 treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908249_0.png resize: (221, 307) 1375495938 -1.8349667961548881 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908272_0.png resize: (224, 173) 1375495939 -3.403979490061237 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908281_0.png resize: (163, 130) 1375495940 -3.835005324525387 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908284_0.png resize: (210, 144) 1375495941 -3.9164196639614297 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908308_0.png resize: (199, 267) 1375495942 -3.7799216097123467 treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908307_0.png resize: (280, 364) 1375495943 -4.403420336114595 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908330_0.png resize: (405, 193) 1375495944 -3.6726904136449816 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908321_0.png resize: (576, 345) 1375495945 -4.457055712255083 treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908327_0.png resize: (242, 195) 1375495946 -4.018663999045548 treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908338_0.png resize: (88, 209) 1375495947 -4.557497039427306 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908357_0.png resize: (188, 286) 1375495948 -4.3050288176452955 treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908363_0.png resize: (161, 169) 1375495949 -3.7198737809389706 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908275_0.png resize: (369, 167) 1375495964 -4.742875837982115 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908290_0.png resize: (185, 126) 1375495965 -4.05326747659087 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908289_0.png resize: (342, 338) 1375495966 -4.23483483969251 treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908292_0.png resize: (350, 314) 1375495967 -4.560948290344061 treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908270_0.png resize: (205, 257) 1375495968 -3.9761644174372592 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.019792795181274414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.036550045013427734 save missing photos in datou_result : time spend for datou_step_exec : 30.518551349639893 time spend to save output : 0.06203436851501465 total time spend for step 6 : 30.580585718154907 step7:brightness Wed Aug 6 16:15:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd.jpg treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3.jpg treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd.jpg treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec.jpg treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d.jpg treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c.jpg treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a.jpg treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908244_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908242_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908248_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908241_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908243_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908247_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908246_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908259_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908257_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908274_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908263_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908256_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908250_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908260_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908266_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908268_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908253_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908251_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908258_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908252_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908262_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908267_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908255_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908265_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908254_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908273_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908269_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908271_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908264_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908261_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908280_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908277_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908283_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908279_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908288_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908276_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908287_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908293_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908291_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908286_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908285_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908282_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908278_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908311_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908303_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908297_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908301_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908304_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908309_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908306_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908298_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908302_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908295_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908299_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908296_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908314_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908315_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908310_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908305_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908294_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908313_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908300_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908312_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908323_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908328_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908317_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908325_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908319_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908329_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908324_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908322_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908318_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908316_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908320_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908326_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908331_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908332_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908333_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908334_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908335_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908337_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908341_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908345_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908344_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908336_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908342_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908343_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908346_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908339_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908340_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908347_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908362_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908348_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908356_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908361_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908350_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908352_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908360_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908349_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908351_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908358_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908353_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908359_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908354_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908355_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908245_0.png treat image : temp/1754489430_1416408_1375486337_ec89c430d78023ba42f37a0c76ce2efd_rle_crop_3904908249_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908272_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908281_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908284_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908308_0.png treat image : temp/1754489430_1416408_1375486202_5db2ab93ad109872e6c404d1f3bf10ec_rle_crop_3904908307_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908330_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908321_0.png treat image : temp/1754489430_1416408_1375486200_e5153de965032774441ff592feb0746d_rle_crop_3904908327_0.png treat image : temp/1754489430_1416408_1375486198_2b4be0e8b5ae7195bdbd65e5138b438c_rle_crop_3904908338_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908357_0.png treat image : temp/1754489430_1416408_1375486194_37d5096f2571effbc57c61d1b7441f9a_rle_crop_3904908363_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908275_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908290_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908289_0.png treat image : temp/1754489430_1416408_1375486204_aaccffeea90fd5800277f54c9a7954bd_rle_crop_3904908292_0.png treat image : temp/1754489430_1416408_1375486271_b75bc963ae41c4506d6b74c49d2a46d3_rle_crop_3904908270_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.01996755599975586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.03648734092712402 save missing photos in datou_result : time spend for datou_step_exec : 8.359312772750854 time spend to save output : 0.06145596504211426 total time spend for step 7 : 8.420768737792969 step8:velours_tree Wed Aug 6 16:15:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.22063922882080078 time spend to save output : 5.0067901611328125e-05 total time spend for step 8 : 0.2206892967224121 step9:send_mail_cod Wed Aug 6 16:15:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25733340_06-08-2025_16_15_14.pdf 25733743 imagette257337431754489714 25733744 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257337441754489714 25733745 imagette257337451754489715 25733746 imagette257337461754489715 25733747 imagette257337471754489715 25733748 change filename to text .imagette257337481754489715 25733750 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257337501754489715 25733751 imagette257337511754489717 25733753 imagette257337531754489717 25733754 change filename to text .change filename to text .change filename to text .change filename to text .imagette257337541754489717 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25733340 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25733743,25733744,25733745,25733746,25733747,25733748,25733750,25733751,25733752,25733753,25733754?tags=background,carton,flou,pehd,mal_croppe,pet_fonce,papier,metal,environnement,autre,pet_clair args[1375486337] : ((1375486337, -5.883850363720725, 492609224), (1375486337, 0.04591449174670111, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com args[1375486271] : ((1375486271, -7.1565835217979545, 492609224), (1375486271, 1.123954473206712, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com args[1375486204] : ((1375486204, -7.574601907532937, 492609224), (1375486204, 1.289971272788331, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com args[1375486202] : ((1375486202, -7.184124318888652, 492609224), (1375486202, 1.4167327224607242, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com args[1375486200] : ((1375486200, -7.155197090132963, 492609224), (1375486200, 1.5269322369614415, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com args[1375486198] : ((1375486198, -6.257007826220379, 492609224), (1375486198, 0.29506735226636055, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com args[1375486194] : ((1375486194, -6.202037405009162, 492609224), (1375486194, 0.3479055733021409, 2107752395), '0.11791282586529983') We are sending mail with results at report@fotonower.com refus_total : 0.11791282586529983 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25733340 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25733340_06-08-2025_16_15_14.pdf results_Auto_P25733340_06-08-2025_16_15_14.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25733340_06-08-2025_16_15_14.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25733340','results_Auto_P25733340_06-08-2025_16_15_14.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25733340_06-08-2025_16_15_14.pdf','pdf','','0.54','0.11791282586529983') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25733340

https://www.fotonower.com/image?json=false&list_photos_id=1375486337
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375486271
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375486204
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375486202
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375486200
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375486198
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375486194
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.79%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25733744?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25733748?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25733750?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25733754?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25733340_06-08-2025_16_15_14.pdf.

Lien vers velours :https://www.fotonower.com/velours/25733743,25733744,25733745,25733746,25733747,25733748,25733750,25733751,25733752,25733753,25733754?tags=background,carton,flou,pehd,mal_croppe,pet_fonce,papier,metal,environnement,autre,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 06 Aug 2025 14:15:20 GMT Content-Length: 0 Connection: close X-Message-Id: TItuZCLhR9OpljOLg3vrVw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375486337, 1375486271, 1375486204, 1375486202, 1375486200, 1375486198, 1375486194] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486337', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486271', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486204', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486202', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486200', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486198', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486194', None, None, None, None, None, '3461963') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015327215194702148 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.936492204666138 time spend to save output : 0.015512228012084961 total time spend for step 9 : 5.952004432678223 step10:split_time_score Wed Aug 6 16:15:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06082025 25733340 Nombre de photos uploadées : 7 / 23040 (0%) 06082025 25733340 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 06082025 25733340 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00037860870361328125 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2012488842010498 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.038778279735932716 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25719358_06-08-2025_10_12_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25719358 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25719358 AND mptpi.`type`=3726 To do Qualite : 0.027938851773159138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25719396_06-08-2025_09_51_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25719396 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25719396 AND mptpi.`type`=3726 To do Qualite : 0.037900901184182156 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25725313_06-08-2025_12_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25725313 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25725313 AND mptpi.`type`=3726 To do Qualite : 0.11791282586529983 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25733340_06-08-2025_16_15_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25733340 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25733340 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06082025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375486337, 1375486271, 1375486204, 1375486202, 1375486200, 1375486198, 1375486194] Looping around the photos to save general results len do output : 1 /25733340Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486337', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486271', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486204', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486202', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486200', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486198', None, None, None, None, None, '3461963') ('3318', None, None, None, None, None, None, None, '3461963') ('3318', '25733340', '1375486194', None, None, None, None, None, '3461963') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014985799789428711 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6104142665863037 time spend to save output : 0.015158891677856445 total time spend for step 10 : 0.6255731582641602 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 124.83user 129.39system 4:55.10elapsed 86%CPU (0avgtext+0avgdata 4645688maxresident)k 685872inputs+112488outputs (14821major+12035551minor)pagefaults 0swaps