python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3760158 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3474296'] with mtr_portfolio_ids : ['25774546'] and first list_photo_ids : [] new path : /proc/3760158/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 30 ; length of list_pids : 30 ; length of list_args : 30 time to download the photos : 4.003038167953491 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Aug 7 12:00:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10801 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-07 12:00:36.254376: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-07 12:00:36.262118: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-07 12:00:36.263708: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb554000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-07 12:00:36.263751: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-07 12:00:36.266068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-07 12:00:36.394074: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x24841810 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-07 12:00:36.394122: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-07 12:00:36.395608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-07 12:00:36.395999: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-07 12:00:36.398759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-07 12:00:36.401284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-07 12:00:36.401784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-07 12:00:36.404856: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-07 12:00:36.406563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-07 12:00:36.411226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-07 12:00:36.412754: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-07 12:00:36.412827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-07 12:00:36.413621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-07 12:00:36.413636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-07 12:00:36.413657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-07 12:00:36.415085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-07 12:00:36.671611: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-07 12:00:36.671704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-07 12:00:36.671732: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-07 12:00:36.671756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-07 12:00:36.671780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-07 12:00:36.671804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-07 12:00:36.671828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-07 12:00:36.671853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-07 12:00:36.673227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-07 12:00:36.674346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-07 12:00:36.674374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-07 12:00:36.674389: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-07 12:00:36.674403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-07 12:00:36.674417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-07 12:00:36.674430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-07 12:00:36.674443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-07 12:00:36.674457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-07 12:00:36.675752: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-07 12:00:36.675780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-07 12:00:36.675788: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-07 12:00:36.675796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-07 12:00:36.677132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-07 12:00:47.165836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-07 12:00:47.429498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 30 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 3761434 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 695 tf kernel not reseted sub process len(results) : 30 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 30 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5984 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 12732 time to create 1 rle with old method : 0.014124155044555664 length of segment : 180 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 2114 time to create 1 rle with old method : 0.002487659454345703 length of segment : 47 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 8353 time to create 1 rle with old method : 0.009239673614501953 length of segment : 111 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 2592 time to create 1 rle with old method : 0.0029897689819335938 length of segment : 66 time for calcul the mask position with numpy : 0.07965421676635742 nb_pixel_total : 1407037 time to create 1 rle with new method : 0.2746593952178955 length of segment : 1274 time for calcul the mask position with numpy : 0.00018453598022460938 nb_pixel_total : 7178 time to create 1 rle with old method : 0.00811910629272461 length of segment : 92 time for calcul the mask position with numpy : 0.0015425682067871094 nb_pixel_total : 112288 time to create 1 rle with old method : 0.11953902244567871 length of segment : 525 time for calcul the mask position with numpy : 0.00024199485778808594 nb_pixel_total : 11327 time to create 1 rle with old method : 0.01223444938659668 length of segment : 184 time for calcul the mask position with numpy : 0.00042438507080078125 nb_pixel_total : 28278 time to create 1 rle with old method : 0.03067183494567871 length of segment : 218 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 2798 time to create 1 rle with old method : 0.003242015838623047 length of segment : 79 time for calcul the mask position with numpy : 0.015618324279785156 nb_pixel_total : 964807 time to create 1 rle with new method : 0.04482221603393555 length of segment : 1481 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 9481 time to create 1 rle with old method : 0.010179281234741211 length of segment : 180 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 7086 time to create 1 rle with old method : 0.007663249969482422 length of segment : 139 time for calcul the mask position with numpy : 0.014283180236816406 nb_pixel_total : 841945 time to create 1 rle with new method : 0.08395504951477051 length of segment : 1495 time for calcul the mask position with numpy : 0.0004696846008300781 nb_pixel_total : 27800 time to create 1 rle with old method : 0.03049325942993164 length of segment : 278 time for calcul the mask position with numpy : 0.0002410411834716797 nb_pixel_total : 11675 time to create 1 rle with old method : 0.014063358306884766 length of segment : 198 time for calcul the mask position with numpy : 0.0018248558044433594 nb_pixel_total : 102737 time to create 1 rle with old method : 0.11406922340393066 length of segment : 544 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 13459 time to create 1 rle with old method : 0.014554977416992188 length of segment : 184 time for calcul the mask position with numpy : 0.0024824142456054688 nb_pixel_total : 113330 time to create 1 rle with old method : 0.12119579315185547 length of segment : 563 time for calcul the mask position with numpy : 0.00021505355834960938 nb_pixel_total : 11926 time to create 1 rle with old method : 0.013277053833007812 length of segment : 172 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0022852420806884766 length of segment : 64 time for calcul the mask position with numpy : 0.016765594482421875 nb_pixel_total : 740355 time to create 1 rle with new method : 0.02151012420654297 length of segment : 932 time for calcul the mask position with numpy : 0.00017714500427246094 nb_pixel_total : 10078 time to create 1 rle with old method : 0.011072397232055664 length of segment : 161 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 4397 time to create 1 rle with old method : 0.004971742630004883 length of segment : 44 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 12475 time to create 1 rle with old method : 0.013360261917114258 length of segment : 179 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 6353 time to create 1 rle with old method : 0.007162570953369141 length of segment : 81 time for calcul the mask position with numpy : 0.0017032623291015625 nb_pixel_total : 118799 time to create 1 rle with old method : 0.12440609931945801 length of segment : 543 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 13201 time to create 1 rle with old method : 0.01443028450012207 length of segment : 128 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 9593 time to create 1 rle with old method : 0.010400533676147461 length of segment : 197 time for calcul the mask position with numpy : 0.021906137466430664 nb_pixel_total : 1467772 time to create 1 rle with new method : 0.20090723037719727 length of segment : 1195 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 8062 time to create 1 rle with old method : 0.008963584899902344 length of segment : 68 time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 10751 time to create 1 rle with old method : 0.011641502380371094 length of segment : 109 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 6497 time to create 1 rle with old method : 0.007287263870239258 length of segment : 86 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 11172 time to create 1 rle with old method : 0.012378454208374023 length of segment : 177 time for calcul the mask position with numpy : 0.053637027740478516 nb_pixel_total : 1133153 time to create 1 rle with new method : 0.07937955856323242 length of segment : 1840 time for calcul the mask position with numpy : 0.002901315689086914 nb_pixel_total : 119350 time to create 1 rle with old method : 0.1250290870666504 length of segment : 563 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 7404 time to create 1 rle with old method : 0.008261919021606445 length of segment : 107 time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 12211 time to create 1 rle with old method : 0.013159513473510742 length of segment : 168 time for calcul the mask position with numpy : 0.05627608299255371 nb_pixel_total : 1123859 time to create 1 rle with new method : 0.0910031795501709 length of segment : 1558 time for calcul the mask position with numpy : 0.0003399848937988281 nb_pixel_total : 5597 time to create 1 rle with old method : 0.006224870681762695 length of segment : 68 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 2910 time to create 1 rle with old method : 0.0035169124603271484 length of segment : 42 time for calcul the mask position with numpy : 0.08858728408813477 nb_pixel_total : 1345173 time to create 1 rle with new method : 0.08785390853881836 length of segment : 1207 time for calcul the mask position with numpy : 0.0016055107116699219 nb_pixel_total : 107761 time to create 1 rle with old method : 0.12117743492126465 length of segment : 521 time for calcul the mask position with numpy : 0.002633810043334961 nb_pixel_total : 103696 time to create 1 rle with old method : 0.11917471885681152 length of segment : 521 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 8347 time to create 1 rle with old method : 0.01008152961730957 length of segment : 175 time for calcul the mask position with numpy : 0.002123594284057617 nb_pixel_total : 95232 time to create 1 rle with old method : 0.10897159576416016 length of segment : 541 time for calcul the mask position with numpy : 0.002257823944091797 nb_pixel_total : 97607 time to create 1 rle with old method : 0.11225414276123047 length of segment : 490 time for calcul the mask position with numpy : 0.00037550926208496094 nb_pixel_total : 9124 time to create 1 rle with old method : 0.010712623596191406 length of segment : 163 time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 7031 time to create 1 rle with old method : 0.008574724197387695 length of segment : 98 time for calcul the mask position with numpy : 0.0003819465637207031 nb_pixel_total : 10614 time to create 1 rle with old method : 0.012473106384277344 length of segment : 174 time for calcul the mask position with numpy : 0.0002772808074951172 nb_pixel_total : 4752 time to create 1 rle with old method : 0.0058176517486572266 length of segment : 131 time for calcul the mask position with numpy : 0.012647390365600586 nb_pixel_total : 731867 time to create 1 rle with new method : 0.20748209953308105 length of segment : 1009 time for calcul the mask position with numpy : 0.00018548965454101562 nb_pixel_total : 5121 time to create 1 rle with old method : 0.00593876838684082 length of segment : 77 time for calcul the mask position with numpy : 0.0017163753509521484 nb_pixel_total : 100047 time to create 1 rle with old method : 0.11484646797180176 length of segment : 545 time for calcul the mask position with numpy : 0.00030922889709472656 nb_pixel_total : 9272 time to create 1 rle with old method : 0.010875940322875977 length of segment : 106 time for calcul the mask position with numpy : 0.00039386749267578125 nb_pixel_total : 11551 time to create 1 rle with old method : 0.013492584228515625 length of segment : 207 time for calcul the mask position with numpy : 0.0023763179779052734 nb_pixel_total : 105051 time to create 1 rle with old method : 0.12062883377075195 length of segment : 533 time for calcul the mask position with numpy : 0.019647598266601562 nb_pixel_total : 1396824 time to create 1 rle with new method : 0.22902917861938477 length of segment : 1300 time for calcul the mask position with numpy : 0.002557516098022461 nb_pixel_total : 88927 time to create 1 rle with old method : 0.10228681564331055 length of segment : 523 time for calcul the mask position with numpy : 0.010300397872924805 nb_pixel_total : 736801 time to create 1 rle with new method : 0.05095267295837402 length of segment : 999 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 11142 time to create 1 rle with old method : 0.013039827346801758 length of segment : 182 time for calcul the mask position with numpy : 0.00018930435180664062 nb_pixel_total : 2467 time to create 1 rle with old method : 0.002989053726196289 length of segment : 79 time for calcul the mask position with numpy : 0.010559320449829102 nb_pixel_total : 664671 time to create 1 rle with new method : 0.0156705379486084 length of segment : 1076 time for calcul the mask position with numpy : 0.0021240711212158203 nb_pixel_total : 107691 time to create 1 rle with old method : 0.12525486946105957 length of segment : 517 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 12659 time to create 1 rle with old method : 0.01481175422668457 length of segment : 177 time for calcul the mask position with numpy : 0.0022063255310058594 nb_pixel_total : 112319 time to create 1 rle with old method : 0.1276857852935791 length of segment : 720 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 4822 time to create 1 rle with old method : 0.006021022796630859 length of segment : 72 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 11393 time to create 1 rle with old method : 0.013586282730102539 length of segment : 151 time for calcul the mask position with numpy : 0.0004858970642089844 nb_pixel_total : 21125 time to create 1 rle with old method : 0.02520918846130371 length of segment : 94 time for calcul the mask position with numpy : 0.00054931640625 nb_pixel_total : 11063 time to create 1 rle with old method : 0.013184070587158203 length of segment : 150 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 6318 time to create 1 rle with old method : 0.011365175247192383 length of segment : 73 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 9859 time to create 1 rle with old method : 0.011996269226074219 length of segment : 118 time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 10503 time to create 1 rle with old method : 0.012186050415039062 length of segment : 166 time for calcul the mask position with numpy : 0.002568960189819336 nb_pixel_total : 90034 time to create 1 rle with old method : 0.10198664665222168 length of segment : 411 time for calcul the mask position with numpy : 0.00020956993103027344 nb_pixel_total : 3349 time to create 1 rle with old method : 0.004289865493774414 length of segment : 40 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 11251 time to create 1 rle with old method : 0.013311386108398438 length of segment : 132 time for calcul the mask position with numpy : 0.002588510513305664 nb_pixel_total : 118329 time to create 1 rle with old method : 0.13483285903930664 length of segment : 551 time for calcul the mask position with numpy : 0.002580404281616211 nb_pixel_total : 108959 time to create 1 rle with old method : 0.12318158149719238 length of segment : 528 time for calcul the mask position with numpy : 0.0003256797790527344 nb_pixel_total : 9868 time to create 1 rle with old method : 0.011569738388061523 length of segment : 106 time for calcul the mask position with numpy : 0.0002605915069580078 nb_pixel_total : 6182 time to create 1 rle with old method : 0.007433414459228516 length of segment : 92 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 10857 time to create 1 rle with old method : 0.012651681900024414 length of segment : 187 time for calcul the mask position with numpy : 0.012075185775756836 nb_pixel_total : 699042 time to create 1 rle with new method : 0.02411198616027832 length of segment : 925 time for calcul the mask position with numpy : 0.00044798851013183594 nb_pixel_total : 9950 time to create 1 rle with old method : 0.011609077453613281 length of segment : 170 time for calcul the mask position with numpy : 0.0026412010192871094 nb_pixel_total : 113551 time to create 1 rle with old method : 0.12978267669677734 length of segment : 539 time for calcul the mask position with numpy : 0.00066375732421875 nb_pixel_total : 22057 time to create 1 rle with old method : 0.025420665740966797 length of segment : 251 time for calcul the mask position with numpy : 0.0024268627166748047 nb_pixel_total : 111366 time to create 1 rle with old method : 0.12577342987060547 length of segment : 539 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 5698 time to create 1 rle with old method : 0.00685882568359375 length of segment : 92 time for calcul the mask position with numpy : 0.0003342628479003906 nb_pixel_total : 9125 time to create 1 rle with old method : 0.010926485061645508 length of segment : 124 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 7230 time to create 1 rle with old method : 0.008366107940673828 length of segment : 145 time for calcul the mask position with numpy : 0.0001323223114013672 nb_pixel_total : 2282 time to create 1 rle with old method : 0.002749919891357422 length of segment : 49 time spent for convertir_results : 9.277506589889526 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 90 chid ids of type : 3594 Number RLEs to save : 34096 save missing photos in datou_result : time spend for datou_step_exec : 41.04576134681702 time spend to save output : 3.939176559448242 total time spend for step 1 : 44.98493790626526 step2:crop_condition Thu Aug 7 12:01:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 30 ! batch 1 Loaded 90 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3736932 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754560881_3760158 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.797203779220581 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754560892_3760158 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5040910243988037 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754560894_3760158 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1811561584472656 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3736932 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754560956_3760158 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 46 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.186768293380737 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754560970_3760158 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5708115100860596 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375606598, 1375606072, 1375606046, 1375606022, 1375605997, 1375605972, 1375605944, 1375605498, 1375605451, 1375605403, 1375605260, 1375605107, 1375605106, 1375605104, 1375605100, 1375605097, 1375605091, 1375604754, 1375604731, 1375604709, 1375604683, 1375604657, 1375604612, 1375604292, 1375604241, 1375604211, 1375604174, 1375604136, 1375604077, 1375603379] Looping around the photos to save general results len do output : 90 /1375643634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375643755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375644377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606598', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606072', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606046', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606022', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605997', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605972', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605944', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605498', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605451', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605403', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605260', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605107', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605106', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605104', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605100', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605097', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605091', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604754', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604731', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604709', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604683', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604657', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604612', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604292', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604241', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604211', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604174', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604136', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604077', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375603379', None, None, None, None, None, '3474296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 300 time used for this insertion : 0.43549394607543945 save_final save missing photos in datou_result : time spend for datou_step_exec : 92.2247543334961 time spend to save output : 0.4386136531829834 total time spend for step 2 : 92.66336798667908 step3:rle_unique_nms_with_priority Thu Aug 7 12:02:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 90 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.4694478511810303 time for calcul the mask position with numpy : 0.010482072830200195 nb_pixel_total : 666232 time to create 1 rle with new method : 0.21796965599060059 time for calcul the mask position with numpy : 0.05246734619140625 nb_pixel_total : 1381577 time to create 1 rle with new method : 0.23734235763549805 time for calcul the mask position with numpy : 0.006185293197631836 nb_pixel_total : 2592 time to create 1 rle with old method : 0.002918243408203125 time for calcul the mask position with numpy : 0.005945444107055664 nb_pixel_total : 8353 time to create 1 rle with old method : 0.008979320526123047 time for calcul the mask position with numpy : 0.00613093376159668 nb_pixel_total : 2114 time to create 1 rle with old method : 0.00238800048828125 time for calcul the mask position with numpy : 0.006343841552734375 nb_pixel_total : 12732 time to create 1 rle with old method : 0.013868093490600586 create new chi : 0.5866317749023438 time to delete rle : 0.022014856338500977 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 4435 TO DO : save crop sub photo not yet done ! save time : 0.36404871940612793 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.32419729232788086 time for calcul the mask position with numpy : 0.1464071273803711 nb_pixel_total : 995442 time to create 1 rle with new method : 0.09784293174743652 time for calcul the mask position with numpy : 0.012276172637939453 nb_pixel_total : 916289 time to create 1 rle with new method : 0.20717263221740723 time for calcul the mask position with numpy : 0.00594639778137207 nb_pixel_total : 2798 time to create 1 rle with old method : 0.003027677536010742 time for calcul the mask position with numpy : 0.006034135818481445 nb_pixel_total : 28278 time to create 1 rle with old method : 0.030618667602539062 time for calcul the mask position with numpy : 0.006251096725463867 nb_pixel_total : 11327 time to create 1 rle with old method : 0.011993408203125 time for calcul the mask position with numpy : 0.006350278854370117 nb_pixel_total : 112288 time to create 1 rle with old method : 0.1205141544342041 time for calcul the mask position with numpy : 0.006137847900390625 nb_pixel_total : 7178 time to create 1 rle with old method : 0.007628440856933594 create new chi : 0.6833362579345703 time to delete rle : 0.0010063648223876953 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 6195 TO DO : save crop sub photo not yet done ! save time : 0.4750988483428955 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0629425048828125 time for calcul the mask position with numpy : 0.013619422912597656 nb_pixel_total : 1196114 time to create 1 rle with new method : 0.09624028205871582 time for calcul the mask position with numpy : 0.006136178970336914 nb_pixel_total : 27800 time to create 1 rle with old method : 0.03000044822692871 time for calcul the mask position with numpy : 0.011790037155151367 nb_pixel_total : 833119 time to create 1 rle with new method : 0.16846251487731934 time for calcul the mask position with numpy : 0.006267070770263672 nb_pixel_total : 7086 time to create 1 rle with old method : 0.007989168167114258 time for calcul the mask position with numpy : 0.006488323211669922 nb_pixel_total : 9481 time to create 1 rle with old method : 0.010601520538330078 create new chi : 0.3652503490447998 time to delete rle : 0.0007345676422119141 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5250 TO DO : save crop sub photo not yet done ! save time : 0.41858363151550293 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04892921447753906 time for calcul the mask position with numpy : 0.07192373275756836 nb_pixel_total : 1959188 time to create 1 rle with new method : 0.132035493850708 time for calcul the mask position with numpy : 0.006492137908935547 nb_pixel_total : 102737 time to create 1 rle with old method : 0.11064767837524414 time for calcul the mask position with numpy : 0.0061075687408447266 nb_pixel_total : 11675 time to create 1 rle with old method : 0.012364625930786133 create new chi : 0.34307241439819336 time to delete rle : 0.0004107952117919922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2564 TO DO : save crop sub photo not yet done ! save time : 0.2708563804626465 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.22564339637756348 time for calcul the mask position with numpy : 0.07357645034790039 nb_pixel_total : 1946811 time to create 1 rle with new method : 0.20330286026000977 time for calcul the mask position with numpy : 0.010864973068237305 nb_pixel_total : 113330 time to create 1 rle with old method : 0.1217811107635498 time for calcul the mask position with numpy : 0.006116151809692383 nb_pixel_total : 13459 time to create 1 rle with old method : 0.014769792556762695 create new chi : 0.44020867347717285 time to delete rle : 0.0004458427429199219 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2574 TO DO : save crop sub photo not yet done ! save time : 0.2536935806274414 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.09181642532348633 time for calcul the mask position with numpy : 0.07418441772460938 nb_pixel_total : 2059928 time to create 1 rle with new method : 0.20569872856140137 time for calcul the mask position with numpy : 0.00623321533203125 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0018732547760009766 time for calcul the mask position with numpy : 0.005999088287353516 nb_pixel_total : 11926 time to create 1 rle with old method : 0.01300668716430664 create new chi : 0.31733131408691406 time to delete rle : 0.0005116462707519531 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1552 TO DO : save crop sub photo not yet done ! save time : 0.1542959213256836 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08626127243041992 time for calcul the mask position with numpy : 0.14260458946228027 nb_pixel_total : 1328848 time to create 1 rle with new method : 0.09460830688476562 time for calcul the mask position with numpy : 0.006201744079589844 nb_pixel_total : 4397 time to create 1 rle with old method : 0.004851818084716797 time for calcul the mask position with numpy : 0.013962507247924805 nb_pixel_total : 740355 time to create 1 rle with new method : 0.14934206008911133 create new chi : 0.42127323150634766 time to delete rle : 0.0003178119659423828 batch 1 Loaded 6 chid ids of type : 3594 +++Number RLEs to save : 3032 TO DO : save crop sub photo not yet done ! save time : 0.314410924911499 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.27286386489868164 time for calcul the mask position with numpy : 0.009734153747558594 nb_pixel_total : 445117 time to create 1 rle with new method : 0.22246527671813965 time for calcul the mask position with numpy : 0.0061490535736083984 nb_pixel_total : 10751 time to create 1 rle with old method : 0.011382579803466797 time for calcul the mask position with numpy : 0.005805492401123047 nb_pixel_total : 8062 time to create 1 rle with old method : 0.008701801300048828 time for calcul the mask position with numpy : 0.059575557708740234 nb_pixel_total : 1449264 time to create 1 rle with new method : 0.20804810523986816 time for calcul the mask position with numpy : 0.0060160160064697266 nb_pixel_total : 9578 time to create 1 rle with old method : 0.010178327560424805 time for calcul the mask position with numpy : 0.005914211273193359 nb_pixel_total : 13201 time to create 1 rle with old method : 0.014374732971191406 time for calcul the mask position with numpy : 0.006672382354736328 nb_pixel_total : 118799 time to create 1 rle with old method : 0.12673163414001465 time for calcul the mask position with numpy : 0.006348848342895508 nb_pixel_total : 6353 time to create 1 rle with old method : 0.007056713104248047 time for calcul the mask position with numpy : 0.0062978267669677734 nb_pixel_total : 12475 time to create 1 rle with old method : 0.013364553451538086 create new chi : 0.7482762336730957 time to delete rle : 0.0010175704956054688 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6063 TO DO : save crop sub photo not yet done ! save time : 0.47886013984680176 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09109044075012207 time for calcul the mask position with numpy : 0.012475252151489258 nb_pixel_total : 940392 time to create 1 rle with new method : 0.041385650634765625 time for calcul the mask position with numpy : 0.016190290451049805 nb_pixel_total : 1115539 time to create 1 rle with new method : 0.03238964080810547 time for calcul the mask position with numpy : 0.006650447845458984 nb_pixel_total : 11172 time to create 1 rle with old method : 0.012581586837768555 time for calcul the mask position with numpy : 0.006555318832397461 nb_pixel_total : 6497 time to create 1 rle with old method : 0.007444620132446289 create new chi : 0.13640666007995605 time to delete rle : 0.001074075698852539 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 5286 TO DO : save crop sub photo not yet done ! save time : 0.4359872341156006 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.41275835037231445 time for calcul the mask position with numpy : 0.017511367797851562 nb_pixel_total : 823920 time to create 1 rle with new method : 0.22996115684509277 time for calcul the mask position with numpy : 0.010062932968139648 nb_pixel_total : 5597 time to create 1 rle with old method : 0.00599360466003418 time for calcul the mask position with numpy : 0.04282975196838379 nb_pixel_total : 1105118 time to create 1 rle with new method : 0.09608125686645508 time for calcul the mask position with numpy : 0.007441282272338867 nb_pixel_total : 12211 time to create 1 rle with old method : 0.01353001594543457 time for calcul the mask position with numpy : 0.0060918331146240234 nb_pixel_total : 7404 time to create 1 rle with old method : 0.00790548324584961 time for calcul the mask position with numpy : 0.0064737796783447266 nb_pixel_total : 119350 time to create 1 rle with old method : 0.12859749794006348 create new chi : 0.5865578651428223 time to delete rle : 0.0009829998016357422 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 6005 TO DO : save crop sub photo not yet done ! save time : 0.5182743072509766 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06545019149780273 time for calcul the mask position with numpy : 0.00983881950378418 nb_pixel_total : 618497 time to create 1 rle with new method : 0.028988361358642578 time for calcul the mask position with numpy : 0.0069599151611328125 nb_pixel_total : 107761 time to create 1 rle with old method : 0.11300945281982422 time for calcul the mask position with numpy : 0.014786958694458008 nb_pixel_total : 1344432 time to create 1 rle with new method : 0.13177275657653809 time for calcul the mask position with numpy : 0.005733489990234375 nb_pixel_total : 2910 time to create 1 rle with old method : 0.003096342086791992 create new chi : 0.31484389305114746 time to delete rle : 0.0007364749908447266 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4617 TO DO : save crop sub photo not yet done ! save time : 0.3808417320251465 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07613396644592285 time for calcul the mask position with numpy : 0.12790679931640625 nb_pixel_total : 1969904 time to create 1 rle with new method : 0.28403425216674805 time for calcul the mask position with numpy : 0.0065462589263916016 nb_pixel_total : 103696 time to create 1 rle with old method : 0.1087186336517334 create new chi : 0.5368919372558594 time to delete rle : 0.0003325939178466797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2122 TO DO : save crop sub photo not yet done ! save time : 0.18984436988830566 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.2017984390258789 time for calcul the mask position with numpy : 0.0755457878112793 nb_pixel_total : 1970021 time to create 1 rle with new method : 0.20125246047973633 time for calcul the mask position with numpy : 0.0104217529296875 nb_pixel_total : 95232 time to create 1 rle with old method : 0.09952306747436523 time for calcul the mask position with numpy : 0.006238460540771484 nb_pixel_total : 8347 time to create 1 rle with old method : 0.008867740631103516 create new chi : 0.4111654758453369 time to delete rle : 0.0004630088806152344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2512 TO DO : save crop sub photo not yet done ! save time : 0.23687291145324707 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.11004495620727539 time for calcul the mask position with numpy : 0.13593554496765137 nb_pixel_total : 1959838 time to create 1 rle with new method : 0.19508957862854004 time for calcul the mask position with numpy : 0.006043195724487305 nb_pixel_total : 7031 time to create 1 rle with old method : 0.0075817108154296875 time for calcul the mask position with numpy : 0.006028175354003906 nb_pixel_total : 9124 time to create 1 rle with old method : 0.00982975959777832 time for calcul the mask position with numpy : 0.0065228939056396484 nb_pixel_total : 97607 time to create 1 rle with old method : 0.1022481918334961 create new chi : 0.47937822341918945 time to delete rle : 0.0004124641418457031 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2582 TO DO : save crop sub photo not yet done ! save time : 0.2520101070404053 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.17467117309570312 time for calcul the mask position with numpy : 0.06820464134216309 nb_pixel_total : 1230585 time to create 1 rle with new method : 0.10613107681274414 time for calcul the mask position with numpy : 0.007069110870361328 nb_pixel_total : 100047 time to create 1 rle with old method : 0.11517572402954102 time for calcul the mask position with numpy : 0.006514072418212891 nb_pixel_total : 5121 time to create 1 rle with old method : 0.0057964324951171875 time for calcul the mask position with numpy : 0.014228582382202148 nb_pixel_total : 722481 time to create 1 rle with new method : 0.34547924995422363 time for calcul the mask position with numpy : 0.005997180938720703 nb_pixel_total : 4752 time to create 1 rle with old method : 0.005220651626586914 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 10614 time to create 1 rle with old method : 0.011197090148925781 create new chi : 0.7062356472015381 time to delete rle : 0.0007665157318115234 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 4815 TO DO : save crop sub photo not yet done ! save time : 0.41079139709472656 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.031633853912353516 time for calcul the mask position with numpy : 0.01822042465209961 nb_pixel_total : 2064328 time to create 1 rle with new method : 0.03152942657470703 time for calcul the mask position with numpy : 0.009859561920166016 nb_pixel_total : 9272 time to create 1 rle with old method : 0.009697198867797852 create new chi : 0.07590866088867188 time to delete rle : 0.0002925395965576172 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1292 TO DO : save crop sub photo not yet done ! save time : 0.1294081211090088 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.11159777641296387 time for calcul the mask position with numpy : 0.009958267211914062 nb_pixel_total : 571506 time to create 1 rle with new method : 0.3078629970550537 time for calcul the mask position with numpy : 0.054549455642700195 nb_pixel_total : 1385492 time to create 1 rle with new method : 0.2700941562652588 time for calcul the mask position with numpy : 0.006435394287109375 nb_pixel_total : 105051 time to create 1 rle with old method : 0.11275291442871094 time for calcul the mask position with numpy : 0.00617527961730957 nb_pixel_total : 11551 time to create 1 rle with old method : 0.012474536895751953 create new chi : 0.795217752456665 time to delete rle : 0.0007627010345458984 batch 1 Loaded 7 chid ids of type : 3594 ++++++++Number RLEs to save : 5158 TO DO : save crop sub photo not yet done ! save time : 0.4258098602294922 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0755319595336914 time for calcul the mask position with numpy : 0.045850276947021484 nb_pixel_total : 1247872 time to create 1 rle with new method : 0.24624156951904297 time for calcul the mask position with numpy : 0.010790824890136719 nb_pixel_total : 736801 time to create 1 rle with new method : 0.22070741653442383 time for calcul the mask position with numpy : 0.006241559982299805 nb_pixel_total : 88927 time to create 1 rle with old method : 0.09277868270874023 create new chi : 0.631572961807251 time to delete rle : 0.0006430149078369141 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 4124 TO DO : save crop sub photo not yet done ! save time : 0.3392484188079834 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05599832534790039 time for calcul the mask position with numpy : 0.020530223846435547 nb_pixel_total : 1395320 time to create 1 rle with new method : 0.09383821487426758 time for calcul the mask position with numpy : 0.01001739501953125 nb_pixel_total : 664671 time to create 1 rle with new method : 0.2162015438079834 time for calcul the mask position with numpy : 0.005781888961791992 nb_pixel_total : 2467 time to create 1 rle with old method : 0.002636432647705078 time for calcul the mask position with numpy : 0.005774021148681641 nb_pixel_total : 11142 time to create 1 rle with old method : 0.011712312698364258 create new chi : 0.3760056495666504 time to delete rle : 0.0006577968597412109 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 3754 TO DO : save crop sub photo not yet done ! save time : 0.318434476852417 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03269553184509277 time for calcul the mask position with numpy : 0.017578601837158203 nb_pixel_total : 1965909 time to create 1 rle with new method : 0.027236223220825195 time for calcul the mask position with numpy : 0.006344795227050781 nb_pixel_total : 107691 time to create 1 rle with old method : 0.11114382743835449 create new chi : 0.16897177696228027 time to delete rle : 0.0003299713134765625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2114 TO DO : save crop sub photo not yet done ! save time : 0.4173398017883301 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.41423892974853516 time for calcul the mask position with numpy : 0.07088279724121094 nb_pixel_total : 1943800 time to create 1 rle with new method : 0.20843768119812012 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 4822 time to create 1 rle with old method : 0.005174875259399414 time for calcul the mask position with numpy : 0.006155729293823242 nb_pixel_total : 112319 time to create 1 rle with old method : 0.11740565299987793 time for calcul the mask position with numpy : 0.005944490432739258 nb_pixel_total : 12659 time to create 1 rle with old method : 0.01360177993774414 create new chi : 0.4429607391357422 time to delete rle : 0.0005357265472412109 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3018 TO DO : save crop sub photo not yet done ! save time : 0.24515080451965332 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03345012664794922 time for calcul the mask position with numpy : 0.018674850463867188 nb_pixel_total : 2062207 time to create 1 rle with new method : 0.08435368537902832 time for calcul the mask position with numpy : 0.005807638168334961 nb_pixel_total : 11393 time to create 1 rle with old method : 0.01183319091796875 create new chi : 0.12748336791992188 time to delete rle : 0.00025010108947753906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1382 TO DO : save crop sub photo not yet done ! save time : 0.4530520439147949 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.031487464904785156 time for calcul the mask position with numpy : 0.15227031707763672 nb_pixel_total : 2052475 time to create 1 rle with new method : 0.08716440200805664 time for calcul the mask position with numpy : 0.005964994430541992 nb_pixel_total : 21125 time to create 1 rle with old method : 0.022271156311035156 create new chi : 0.275982141494751 time to delete rle : 0.0002455711364746094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1268 TO DO : save crop sub photo not yet done ! save time : 0.12506484985351562 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.5216333866119385 time for calcul the mask position with numpy : 0.16089892387390137 nb_pixel_total : 1945823 time to create 1 rle with new method : 0.09441447257995605 time for calcul the mask position with numpy : 0.006386518478393555 nb_pixel_total : 90034 time to create 1 rle with old method : 0.09453535079956055 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 10503 time to create 1 rle with old method : 0.01080322265625 time for calcul the mask position with numpy : 0.005575895309448242 nb_pixel_total : 9859 time to create 1 rle with old method : 0.010368108749389648 time for calcul the mask position with numpy : 0.005902528762817383 nb_pixel_total : 6318 time to create 1 rle with old method : 0.006537914276123047 time for calcul the mask position with numpy : 0.006051540374755859 nb_pixel_total : 11063 time to create 1 rle with old method : 0.011774301528930664 create new chi : 0.42949438095092773 time to delete rle : 0.0004949569702148438 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2916 TO DO : save crop sub photo not yet done ! save time : 0.38830018043518066 No data in photo_id : 1375604241 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.16856622695922852 time for calcul the mask position with numpy : 0.06753802299499512 nb_pixel_total : 1940671 time to create 1 rle with new method : 0.19698667526245117 time for calcul the mask position with numpy : 0.006418943405151367 nb_pixel_total : 118329 time to create 1 rle with old method : 0.12250208854675293 time for calcul the mask position with numpy : 0.0070116519927978516 nb_pixel_total : 11251 time to create 1 rle with old method : 0.012276887893676758 time for calcul the mask position with numpy : 0.00622105598449707 nb_pixel_total : 3349 time to create 1 rle with old method : 0.003637075424194336 create new chi : 0.4291675090789795 time to delete rle : 0.00044655799865722656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2526 TO DO : save crop sub photo not yet done ! save time : 0.43410491943359375 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.0704793930053711 time for calcul the mask position with numpy : 0.04726433753967285 nb_pixel_total : 1244960 time to create 1 rle with new method : 0.15757322311401367 time for calcul the mask position with numpy : 0.010431051254272461 nb_pixel_total : 692774 time to create 1 rle with new method : 0.1872720718383789 time for calcul the mask position with numpy : 0.010308980941772461 nb_pixel_total : 10857 time to create 1 rle with old method : 0.011832237243652344 time for calcul the mask position with numpy : 0.009604215621948242 nb_pixel_total : 6182 time to create 1 rle with old method : 0.006705760955810547 time for calcul the mask position with numpy : 0.009963512420654297 nb_pixel_total : 9868 time to create 1 rle with old method : 0.010293722152709961 time for calcul the mask position with numpy : 0.0066034793853759766 nb_pixel_total : 108959 time to create 1 rle with old method : 0.11239814758300781 create new chi : 0.589522123336792 time to delete rle : 0.0007503032684326172 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4630 TO DO : save crop sub photo not yet done ! save time : 0.610353946685791 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0742940902709961 time for calcul the mask position with numpy : 0.017929553985595703 nb_pixel_total : 1928042 time to create 1 rle with new method : 0.05767369270324707 time for calcul the mask position with numpy : 0.005931854248046875 nb_pixel_total : 22057 time to create 1 rle with old method : 0.023231983184814453 time for calcul the mask position with numpy : 0.006293296813964844 nb_pixel_total : 113551 time to create 1 rle with old method : 0.1181802749633789 time for calcul the mask position with numpy : 0.005774974822998047 nb_pixel_total : 9950 time to create 1 rle with old method : 0.010384559631347656 create new chi : 0.2520792484283447 time to delete rle : 0.0005469322204589844 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3000 TO DO : save crop sub photo not yet done ! save time : 0.3808410167694092 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0570065975189209 time for calcul the mask position with numpy : 0.03973889350891113 nb_pixel_total : 1940181 time to create 1 rle with new method : 0.17978453636169434 time for calcul the mask position with numpy : 0.006044149398803711 nb_pixel_total : 7230 time to create 1 rle with old method : 0.007974386215209961 time for calcul the mask position with numpy : 0.006008148193359375 nb_pixel_total : 9125 time to create 1 rle with old method : 0.010242462158203125 time for calcul the mask position with numpy : 0.006003618240356445 nb_pixel_total : 5698 time to create 1 rle with old method : 0.006284475326538086 time for calcul the mask position with numpy : 0.006487131118774414 nb_pixel_total : 111366 time to create 1 rle with old method : 0.12095785140991211 create new chi : 0.39974141120910645 time to delete rle : 0.0004918575286865234 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2880 TO DO : save crop sub photo not yet done ! save time : 0.2578301429748535 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03397870063781738 time for calcul the mask position with numpy : 0.01929163932800293 nb_pixel_total : 2071318 time to create 1 rle with new method : 0.08737802505493164 time for calcul the mask position with numpy : 0.006104230880737305 nb_pixel_total : 2282 time to create 1 rle with old method : 0.0025827884674072266 create new chi : 0.13031387329101562 time to delete rle : 0.00027179718017578125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1178 TO DO : save crop sub photo not yet done ! save time : 0.18476581573486328 map_output_result : {1375606598: (0.0, 'Should be the crop_list due to order', 0), 1375606072: (0.0, 'Should be the crop_list due to order', 0), 1375606046: (0.0, 'Should be the crop_list due to order', 0), 1375606022: (0.0, 'Should be the crop_list due to order', 0), 1375605997: (0.0, 'Should be the crop_list due to order', 0), 1375605972: (0.0, 'Should be the crop_list due to order', 0), 1375605944: (0.0, 'Should be the crop_list due to order', 0), 1375605498: (0.0, 'Should be the crop_list due to order', 0), 1375605451: (0.0, 'Should be the crop_list due to order', 0), 1375605403: (0.0, 'Should be the crop_list due to order', 0), 1375605260: (0.0, 'Should be the crop_list due to order', 0), 1375605107: (0.0, 'Should be the crop_list due to order', 0), 1375605106: (0.0, 'Should be the crop_list due to order', 0), 1375605104: (0.0, 'Should be the crop_list due to order', 0), 1375605100: (0.0, 'Should be the crop_list due to order', 0), 1375605097: (0.0, 'Should be the crop_list due to order', 0), 1375605091: (0.0, 'Should be the crop_list due to order', 0), 1375604754: (0.0, 'Should be the crop_list due to order', 0), 1375604731: (0.0, 'Should be the crop_list due to order', 0), 1375604709: (0.0, 'Should be the crop_list due to order', 0), 1375604683: (0.0, 'Should be the crop_list due to order', 0), 1375604657: (0.0, 'Should be the crop_list due to order', 0), 1375604612: (0.0, 'Should be the crop_list due to order', 0), 1375604292: (0.0, 'Should be the crop_list due to order', 0), 1375604241: (0.0, 'Should be the crop_list due to order', 0.0), 1375604211: (0.0, 'Should be the crop_list due to order', 0), 1375604174: (0.0, 'Should be the crop_list due to order', 0), 1375604136: (0.0, 'Should be the crop_list due to order', 0), 1375604077: (0.0, 'Should be the crop_list due to order', 0), 1375603379: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375606598, 1375606072, 1375606046, 1375606022, 1375605997, 1375605972, 1375605944, 1375605498, 1375605451, 1375605403, 1375605260, 1375605107, 1375605106, 1375605104, 1375605100, 1375605097, 1375605091, 1375604754, 1375604731, 1375604709, 1375604683, 1375604657, 1375604612, 1375604292, 1375604241, 1375604211, 1375604174, 1375604136, 1375604077, 1375603379] Looping around the photos to save general results len do output : 30 /1375606598.Didn't retrieve data . /1375606072.Didn't retrieve data . /1375606046.Didn't retrieve data . /1375606022.Didn't retrieve data . /1375605997.Didn't retrieve data . /1375605972.Didn't retrieve data . /1375605944.Didn't retrieve data . /1375605498.Didn't retrieve data . /1375605451.Didn't retrieve data . /1375605403.Didn't retrieve data . /1375605260.Didn't retrieve data . /1375605107.Didn't retrieve data . /1375605106.Didn't retrieve data . /1375605104.Didn't retrieve data . /1375605100.Didn't retrieve data . /1375605097.Didn't retrieve data . /1375605091.Didn't retrieve data . /1375604754.Didn't retrieve data . /1375604731.Didn't retrieve data . /1375604709.Didn't retrieve data . /1375604683.Didn't retrieve data . /1375604657.Didn't retrieve data . /1375604612.Didn't retrieve data . /1375604292.Didn't retrieve data . /1375604241.Didn't retrieve data . /1375604211.Didn't retrieve data . /1375604174.Didn't retrieve data . /1375604136.Didn't retrieve data . /1375604077.Didn't retrieve data . /1375603379.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606598', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606072', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606046', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606022', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605997', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605972', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605944', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605498', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605451', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605403', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605260', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605107', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605106', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605104', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605100', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605097', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605091', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604754', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604731', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604709', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604683', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604657', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604612', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604292', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604241', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604211', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604174', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604136', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604077', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375603379', None, None, None, None, None, '3474296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 90 time used for this insertion : 0.02182483673095703 save_final save missing photos in datou_result : time spend for datou_step_exec : 27.83341383934021 time spend to save output : 0.022917747497558594 total time spend for step 3 : 27.85633158683777 step4:ventilate_hashtags_in_portfolio Thu Aug 7 12:03:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25774546 get user id for portfolio 25774546 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25774546 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','autre','pet_fonce','metal','papier','flou','pehd','pet_clair','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25774546 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','autre','pet_fonce','metal','papier','flou','pehd','pet_clair','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25775308,25775309,25775310,25775312,25775313,25775314,25775315,25775316,25775317,25775318,25775319?tags=carton,autre,pet_clair,papier,flou,mal_croppe,pet_fonce,background,pehd,metal,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375606598, 1375606072, 1375606046, 1375606022, 1375605997, 1375605972, 1375605944, 1375605498, 1375605451, 1375605403, 1375605260, 1375605107, 1375605106, 1375605104, 1375605100, 1375605097, 1375605091, 1375604754, 1375604731, 1375604709, 1375604683, 1375604657, 1375604612, 1375604292, 1375604241, 1375604211, 1375604174, 1375604136, 1375604077, 1375603379] Looping around the photos to save general results len do output : 1 /25774546. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606598', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606072', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606046', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606022', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605997', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605972', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605944', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605498', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605451', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605403', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605260', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605107', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605106', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605104', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605100', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605097', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605091', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604754', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604731', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604709', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604683', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604657', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604612', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604292', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604241', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604211', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604174', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604136', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604077', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375603379', None, None, None, None, None, '3474296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 31 time used for this insertion : 0.1682908535003662 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5302436351776123 time spend to save output : 0.16868185997009277 total time spend for step 4 : 0.6989254951477051 step5:final Thu Aug 7 12:03:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375606598: ('0.23233583416005285',), 1375606072: ('0.23233583416005285',), 1375606046: ('0.23233583416005285',), 1375606022: ('0.23233583416005285',), 1375605997: ('0.23233583416005285',), 1375605972: ('0.23233583416005285',), 1375605944: ('0.23233583416005285',), 1375605498: ('0.23233583416005285',), 1375605451: ('0.23233583416005285',), 1375605403: ('0.23233583416005285',), 1375605260: ('0.23233583416005285',), 1375605107: ('0.23233583416005285',), 1375605106: ('0.23233583416005285',), 1375605104: ('0.23233583416005285',), 1375605100: ('0.23233583416005285',), 1375605097: ('0.23233583416005285',), 1375605091: ('0.23233583416005285',), 1375604754: ('0.23233583416005285',), 1375604731: ('0.23233583416005285',), 1375604709: ('0.23233583416005285',), 1375604683: ('0.23233583416005285',), 1375604657: ('0.23233583416005285',), 1375604612: ('0.23233583416005285',), 1375604292: ('0.23233583416005285',), 1375604241: ('0.23233583416005285',), 1375604211: ('0.23233583416005285',), 1375604174: ('0.23233583416005285',), 1375604136: ('0.23233583416005285',), 1375604077: ('0.23233583416005285',), 1375603379: ('0.23233583416005285',)} new output for save of step final : {1375606598: ('0.23233583416005285',), 1375606072: ('0.23233583416005285',), 1375606046: ('0.23233583416005285',), 1375606022: ('0.23233583416005285',), 1375605997: ('0.23233583416005285',), 1375605972: ('0.23233583416005285',), 1375605944: ('0.23233583416005285',), 1375605498: ('0.23233583416005285',), 1375605451: ('0.23233583416005285',), 1375605403: ('0.23233583416005285',), 1375605260: ('0.23233583416005285',), 1375605107: ('0.23233583416005285',), 1375605106: ('0.23233583416005285',), 1375605104: ('0.23233583416005285',), 1375605100: ('0.23233583416005285',), 1375605097: ('0.23233583416005285',), 1375605091: ('0.23233583416005285',), 1375604754: ('0.23233583416005285',), 1375604731: ('0.23233583416005285',), 1375604709: ('0.23233583416005285',), 1375604683: ('0.23233583416005285',), 1375604657: ('0.23233583416005285',), 1375604612: ('0.23233583416005285',), 1375604292: ('0.23233583416005285',), 1375604241: ('0.23233583416005285',), 1375604211: ('0.23233583416005285',), 1375604174: ('0.23233583416005285',), 1375604136: ('0.23233583416005285',), 1375604077: ('0.23233583416005285',), 1375603379: ('0.23233583416005285',)} [1375606598, 1375606072, 1375606046, 1375606022, 1375605997, 1375605972, 1375605944, 1375605498, 1375605451, 1375605403, 1375605260, 1375605107, 1375605106, 1375605104, 1375605100, 1375605097, 1375605091, 1375604754, 1375604731, 1375604709, 1375604683, 1375604657, 1375604612, 1375604292, 1375604241, 1375604211, 1375604174, 1375604136, 1375604077, 1375603379] Looping around the photos to save general results len do output : 30 /1375606598.Didn't retrieve data . /1375606072.Didn't retrieve data . /1375606046.Didn't retrieve data . /1375606022.Didn't retrieve data . /1375605997.Didn't retrieve data . /1375605972.Didn't retrieve data . /1375605944.Didn't retrieve data . /1375605498.Didn't retrieve data . /1375605451.Didn't retrieve data . /1375605403.Didn't retrieve data . /1375605260.Didn't retrieve data . /1375605107.Didn't retrieve data . /1375605106.Didn't retrieve data . /1375605104.Didn't retrieve data . /1375605100.Didn't retrieve data . /1375605097.Didn't retrieve data . /1375605091.Didn't retrieve data . /1375604754.Didn't retrieve data . /1375604731.Didn't retrieve data . /1375604709.Didn't retrieve data . /1375604683.Didn't retrieve data . /1375604657.Didn't retrieve data . /1375604612.Didn't retrieve data . /1375604292.Didn't retrieve data . /1375604241.Didn't retrieve data . /1375604211.Didn't retrieve data . /1375604174.Didn't retrieve data . /1375604136.Didn't retrieve data . /1375604077.Didn't retrieve data . /1375603379.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606598', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606072', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606046', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606022', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605997', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605972', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605944', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605498', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605451', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605403', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605260', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605107', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605106', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605104', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605100', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605097', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605091', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604754', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604731', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604709', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604683', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604657', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604612', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604292', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604241', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604211', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604174', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604136', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604077', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375603379', None, None, None, None, None, '3474296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 90 time used for this insertion : 0.09904265403747559 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.17299771308898926 time spend to save output : 0.10035347938537598 total time spend for step 5 : 0.27335119247436523 step6:blur_detection Thu Aug 7 12:03:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e.jpg resize: (1080, 1920) 1375606598 -1.8950764656971055 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff.jpg resize: (1080, 1920) 1375606072 -2.748125220143486 treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2.jpg resize: (1080, 1920) 1375606046 -1.548749439824888 treat image : temp/1754560829_3760158_1375606022_0f440510c918c50b1086fe8337ec8d32.jpg resize: (1080, 1920) 1375606022 -1.9731732492390146 treat image : temp/1754560829_3760158_1375605997_5afab21883deefae2eab3b87ee64db38.jpg resize: (1080, 1920) 1375605997 -2.0293337673175493 treat image : temp/1754560829_3760158_1375605972_f635817caaa500ce86eb0d3805b2293a.jpg resize: (1080, 1920) 1375605972 -2.4840263341478077 treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a.jpg resize: (1080, 1920) 1375605944 -2.4689728375778452 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b.jpg resize: (1080, 1920) 1375605498 -1.9214200034965099 treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011.jpg resize: (1080, 1920) 1375605451 -1.9521064981268352 treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d.jpg resize: (1080, 1920) 1375605403 -4.2892491601013685 treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3.jpg resize: (1080, 1920) 1375605260 -2.145531073278135 treat image : temp/1754560829_3760158_1375605107_5de5d37866a775ddc7f3e9293471e5c8.jpg resize: (1080, 1920) 1375605107 -2.6079540559090595 treat image : temp/1754560829_3760158_1375605106_666d85f26bbf3996d84ab006f490f82b.jpg resize: (1080, 1920) 1375605106 -2.3046022194528155 treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af.jpg resize: (1080, 1920) 1375605104 -1.9180495459431488 treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7.jpg resize: (1080, 1920) 1375605100 -2.4647200849399375 treat image : temp/1754560829_3760158_1375605097_6857e59b99fa598923d8a10c170cec1d.jpg resize: (1080, 1920) 1375605097 -1.8005678843680168 treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193.jpg resize: (1080, 1920) 1375605091 -2.22789755453314 treat image : temp/1754560829_3760158_1375604754_d687ff11cc103e31862c74b616000a9c.jpg resize: (1080, 1920) 1375604754 -2.432802766294573 treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92.jpg resize: (1080, 1920) 1375604731 -2.2313398007754954 treat image : temp/1754560829_3760158_1375604709_54a3bb5a301b98553cda81526258b665.jpg resize: (1080, 1920) 1375604709 -2.4029758162700925 treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902.jpg resize: (1080, 1920) 1375604683 -2.347967652845112 treat image : temp/1754560829_3760158_1375604657_dcc921973008013b0986bb617e267e3e.jpg resize: (1080, 1920) 1375604657 -2.921599714138635 treat image : temp/1754560829_3760158_1375604612_ace30f7d096c8eaef5191c39582e431e.jpg resize: (1080, 1920) 1375604612 -2.8820294888865865 treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12.jpg resize: (1080, 1920) 1375604292 -2.8570896239753356 treat image : temp/1754560829_3760158_1375604241_e71151c9d85ace0b2c54040d60ffd19a.jpg resize: (1080, 1920) 1375604241 -2.0690246654677105 treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c.jpg resize: (1080, 1920) 1375604211 -2.2317727706726234 treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c.jpg resize: (1080, 1920) 1375604174 -0.21261768047840762 treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1.jpg resize: (1080, 1920) 1375604136 -1.9389699223498265 treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db.jpg resize: (1080, 1920) 1375604077 -2.452135194396545 treat image : temp/1754560829_3760158_1375603379_a77e1f3ffafdd7231e105fe1056fbcd5.jpg resize: (1080, 1920) 1375603379 -1.7138554838971372 treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824065_0.png resize: (180, 87) 1375643634 -0.008697522923627432 treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824066_0.png resize: (46, 56) 1375643636 20.0 treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824067_0.png resize: (108, 116) 1375643639 -1.5409017444960227 treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824068_0.png resize: (66, 69) 1375643640 -2.395937323102876 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824070_0.png resize: (90, 115) 1375643642 -1.335846343161074 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824072_0.png resize: (175, 84) 1375643644 -1.2993275606022132 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824074_0.png resize: (79, 65) 1375643645 -2.475426897214007 treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824076_0.png resize: (180, 68) 1375643647 -0.21946381881032512 treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824077_0.png resize: (139, 84) 1375643649 -1.681262165761193 treat image : temp/1754560829_3760158_1375605997_5afab21883deefae2eab3b87ee64db38_rle_crop_3905824082_0.png resize: (184, 94) 1375643650 0.35037529764378167 treat image : temp/1754560829_3760158_1375605972_f635817caaa500ce86eb0d3805b2293a_rle_crop_3905824084_0.png resize: (172, 91) 1375643652 -1.8447301563453635 treat image : temp/1754560829_3760158_1375605972_f635817caaa500ce86eb0d3805b2293a_rle_crop_3905824085_0.png resize: (64, 35) 1375643654 5.554469862413467 treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a_rle_crop_3905824087_0.png resize: (161, 74) 1375643655 -0.27668572935976243 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824089_0.png resize: (179, 91) 1375643657 -1.8754464847191488 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824090_0.png resize: (81, 110) 1375643659 -1.3692767563457182 treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011_rle_crop_3905824097_0.png resize: (84, 111) 1375643661 -1.2536487439898325 treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011_rle_crop_3905824098_0.png resize: (166, 89) 1375643662 -0.24138452260248974 treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824101_0.png resize: (100, 117) 1375643665 -2.422498116571463 treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824102_0.png resize: (168, 97) 1375643667 -3.305877671144904 treat image : temp/1754560829_3760158_1375605106_666d85f26bbf3996d84ab006f490f82b_rle_crop_3905824109_0.png resize: (175, 64) 1375643668 0.9826387342176511 treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af_rle_crop_3905824112_0.png resize: (148, 84) 1375643670 0.07550394758428756 treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af_rle_crop_3905824113_0.png resize: (98, 142) 1375643672 -2.0073915476354984 treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824114_0.png resize: (168, 77) 1375643674 -1.8532593608930894 treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824115_0.png resize: (131, 72) 1375643675 -2.2359657021703843 treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193_rle_crop_3905824120_0.png resize: (177, 86) 1375643677 -1.5082333228581468 treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92_rle_crop_3905824125_0.png resize: (168, 84) 1375643679 -1.3632755373934056 treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92_rle_crop_3905824126_0.png resize: (79, 37) 1375643680 3.3753969220979707 treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902_rle_crop_3905824129_0.png resize: (177, 97) 1375643682 -0.9618463571399776 treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902_rle_crop_3905824131_0.png resize: (72, 85) 1375643684 -0.053192184099790984 treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824134_0.png resize: (150, 131) 1375643685 -1.6041597032436976 treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824135_0.png resize: (73, 133) 1375643687 -2.4660262647694187 treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824137_0.png resize: (166, 94) 1375643689 -1.3982825665868193 treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824144_0.png resize: (82, 104) 1375643690 -0.9921884602143235 treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824145_0.png resize: (187, 83) 1375643692 -0.401349830774095 treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1_rle_crop_3905824147_0.png resize: (170, 79) 1375643694 -0.8724580995700159 treat image : temp/1754560829_3760158_1375603379_a77e1f3ffafdd7231e105fe1056fbcd5_rle_crop_3905824154_0.png resize: (49, 53) 1375643695 7.485451944282562 treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824136_0.png resize: (114, 104) 1375643724 0.09856331548524601 treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c_rle_crop_3905824140_0.png resize: (131, 103) 1375643726 0.43088828170585564 treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824151_0.png resize: (77, 96) 1375643728 -1.1329668893966716 treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824153_0.png resize: (145, 74) 1375643729 -1.5570096700809377 treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a_rle_crop_3905824088_0.png resize: (44, 135) 1375643752 -2.0357250407858674 treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824104_0.png resize: (67, 116) 1375643754 -1.413511182827713 treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824117_0.png resize: (77, 89) 1375643755 -0.4765231701719241 treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824069_0.png resize: (985, 1535) 1375644320 -2.035608252115869 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824071_0.png resize: (525, 337) 1375644322 0.19053188110763458 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824073_0.png resize: (195, 224) 1375644323 -3.651865462459975 treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824075_0.png resize: (932, 1347) 1375644324 -2.125158006580866 treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824078_0.png resize: (996, 1146) 1375644326 -1.5474422283401505 treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824079_0.png resize: (243, 153) 1375644327 -1.2808409710630684 treat image : temp/1754560829_3760158_1375606022_0f440510c918c50b1086fe8337ec8d32_rle_crop_3905824080_0.png resize: (197, 81) 1375644328 -1.643116350200166 treat image : temp/1754560829_3760158_1375606022_0f440510c918c50b1086fe8337ec8d32_rle_crop_3905824081_0.png resize: (520, 354) 1375644330 -0.17151788312597588 treat image : temp/1754560829_3760158_1375605997_5afab21883deefae2eab3b87ee64db38_rle_crop_3905824083_0.png resize: (554, 348) 1375644331 0.21576617392867223 treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a_rle_crop_3905824086_0.png resize: (930, 1032) 1375644333 -0.12203099627918577 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824091_0.png resize: (538, 363) 1375644334 0.33185186089428054 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824092_0.png resize: (116, 140) 1375644335 -2.0887581875867904 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824093_0.png resize: (195, 64) 1375644337 -0.6159607576893831 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824094_0.png resize: (931, 1750) 1375644338 -1.97222001021266 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824095_0.png resize: (64, 189) 1375644339 -3.029082949238333 treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824096_0.png resize: (109, 117) 1375644341 -1.0657147545753538 treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011_rle_crop_3905824099_0.png resize: (1003, 1336) 1375644342 -1.9727578206277514 treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824100_0.png resize: (561, 367) 1375644343 0.04582751188417494 treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824103_0.png resize: (934, 1719) 1375644345 -2.045673809494895 treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3_rle_crop_3905824105_0.png resize: (40, 81) 1375644346 -0.5370129996383167 treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3_rle_crop_3905824106_0.png resize: (928, 1539) 1375644348 -2.1965666144274505 treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3_rle_crop_3905824107_0.png resize: (517, 339) 1375644349 0.08950687871231779 treat image : temp/1754560829_3760158_1375605107_5de5d37866a775ddc7f3e9293471e5c8_rle_crop_3905824108_0.png resize: (489, 329) 1375644350 0.11504441189171306 treat image : temp/1754560829_3760158_1375605106_666d85f26bbf3996d84ab006f490f82b_rle_crop_3905824110_0.png resize: (516, 323) 1375644351 -0.23206376215780133 treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af_rle_crop_3905824111_0.png resize: (487, 357) 1375644352 -0.34273793004810027 treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824116_0.png resize: (985, 972) 1375644353 -0.06464946361131492 treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824118_0.png resize: (495, 328) 1375644354 -0.37864139046876844 treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193_rle_crop_3905824121_0.png resize: (528, 335) 1375644355 0.09473711045427066 treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193_rle_crop_3905824122_0.png resize: (937, 1633) 1375644356 -2.039820426793935 treat image : temp/1754560829_3760158_1375604754_d687ff11cc103e31862c74b616000a9c_rle_crop_3905824123_0.png resize: (517, 344) 1375644357 -0.19080336163840855 treat image : temp/1754560829_3760158_1375604754_d687ff11cc103e31862c74b616000a9c_rle_crop_3905824124_0.png resize: (993, 1002) 1375644358 0.0103002896579244 treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92_rle_crop_3905824127_0.png resize: (932, 892) 1375644359 -0.24232020644469704 treat image : temp/1754560829_3760158_1375604709_54a3bb5a301b98553cda81526258b665_rle_crop_3905824128_0.png resize: (514, 349) 1375644360 0.3264777114982888 treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902_rle_crop_3905824130_0.png resize: (515, 387) 1375644361 -0.7777198170951695 treat image : temp/1754560829_3760158_1375604657_dcc921973008013b0986bb617e267e3e_rle_crop_3905824132_0.png resize: (150, 104) 1375644362 -3.7891902407482827 treat image : temp/1754560829_3760158_1375604612_ace30f7d096c8eaef5191c39582e431e_rle_crop_3905824133_0.png resize: (91, 286) 1375644363 -3.6467454193779307 treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824138_0.png resize: (403, 343) 1375644364 -0.22528311796107234 treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c_rle_crop_3905824139_0.png resize: (40, 109) 1375644365 -4.0966726367846125 treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c_rle_crop_3905824141_0.png resize: (541, 334) 1375644367 -0.0014134153918628945 treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824142_0.png resize: (524, 328) 1375644368 0.1334341486317835 treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824143_0.png resize: (103, 113) 1375644369 -1.765836190671658 treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824146_0.png resize: (916, 971) 1375644370 1.368529624877701 treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1_rle_crop_3905824148_0.png resize: (536, 352) 1375644371 -0.06259947499221706 treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1_rle_crop_3905824149_0.png resize: (236, 115) 1375644372 -2.599929260884322 treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824150_0.png resize: (536, 324) 1375644373 0.11558667640028002 treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824152_0.png resize: (124, 96) 1375644375 -2.9999590971465975 treat image : temp/1754560829_3760158_1375605097_6857e59b99fa598923d8a10c170cec1d_rle_crop_3905824119_0.png resize: (102, 121) 1375644377 -3.8493971665558813 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 120 time used for this insertion : 0.023049116134643555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 120 time used for this insertion : 0.03115081787109375 save missing photos in datou_result : time spend for datou_step_exec : 30.188212633132935 time spend to save output : 0.060100555419921875 total time spend for step 6 : 30.248313188552856 step7:brightness Thu Aug 7 12:03:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e.jpg treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff.jpg treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2.jpg treat image : temp/1754560829_3760158_1375606022_0f440510c918c50b1086fe8337ec8d32.jpg treat image : temp/1754560829_3760158_1375605997_5afab21883deefae2eab3b87ee64db38.jpg treat image : temp/1754560829_3760158_1375605972_f635817caaa500ce86eb0d3805b2293a.jpg treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a.jpg treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b.jpg treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011.jpg treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d.jpg treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3.jpg treat image : temp/1754560829_3760158_1375605107_5de5d37866a775ddc7f3e9293471e5c8.jpg treat image : temp/1754560829_3760158_1375605106_666d85f26bbf3996d84ab006f490f82b.jpg treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af.jpg treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7.jpg treat image : temp/1754560829_3760158_1375605097_6857e59b99fa598923d8a10c170cec1d.jpg treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193.jpg treat image : temp/1754560829_3760158_1375604754_d687ff11cc103e31862c74b616000a9c.jpg treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92.jpg treat image : temp/1754560829_3760158_1375604709_54a3bb5a301b98553cda81526258b665.jpg treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902.jpg treat image : temp/1754560829_3760158_1375604657_dcc921973008013b0986bb617e267e3e.jpg treat image : temp/1754560829_3760158_1375604612_ace30f7d096c8eaef5191c39582e431e.jpg treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12.jpg treat image : temp/1754560829_3760158_1375604241_e71151c9d85ace0b2c54040d60ffd19a.jpg treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c.jpg treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c.jpg treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1.jpg treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db.jpg treat image : temp/1754560829_3760158_1375603379_a77e1f3ffafdd7231e105fe1056fbcd5.jpg treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824065_0.png treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824066_0.png treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824067_0.png treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824068_0.png treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824070_0.png treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824072_0.png treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824074_0.png treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824076_0.png treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824077_0.png treat image : temp/1754560829_3760158_1375605997_5afab21883deefae2eab3b87ee64db38_rle_crop_3905824082_0.png treat image : temp/1754560829_3760158_1375605972_f635817caaa500ce86eb0d3805b2293a_rle_crop_3905824084_0.png treat image : temp/1754560829_3760158_1375605972_f635817caaa500ce86eb0d3805b2293a_rle_crop_3905824085_0.png treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a_rle_crop_3905824087_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824089_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824090_0.png treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011_rle_crop_3905824097_0.png treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011_rle_crop_3905824098_0.png treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824101_0.png treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824102_0.png treat image : temp/1754560829_3760158_1375605106_666d85f26bbf3996d84ab006f490f82b_rle_crop_3905824109_0.png treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af_rle_crop_3905824112_0.png treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af_rle_crop_3905824113_0.png treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824114_0.png treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824115_0.png treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193_rle_crop_3905824120_0.png treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92_rle_crop_3905824125_0.png treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92_rle_crop_3905824126_0.png treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902_rle_crop_3905824129_0.png treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902_rle_crop_3905824131_0.png treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824134_0.png treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824135_0.png treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824137_0.png treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824144_0.png treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824145_0.png treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1_rle_crop_3905824147_0.png treat image : temp/1754560829_3760158_1375603379_a77e1f3ffafdd7231e105fe1056fbcd5_rle_crop_3905824154_0.png treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824136_0.png treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c_rle_crop_3905824140_0.png treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824151_0.png treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824153_0.png treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a_rle_crop_3905824088_0.png treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824104_0.png treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824117_0.png treat image : temp/1754560829_3760158_1375606598_9e18a83d257f055fdb1ba4a1decba03e_rle_crop_3905824069_0.png treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824071_0.png treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824073_0.png treat image : temp/1754560829_3760158_1375606072_eeeeb8da363adee8c2b9cbcc90b38aff_rle_crop_3905824075_0.png treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824078_0.png treat image : temp/1754560829_3760158_1375606046_47d7cacecc695c0056d74a36708474c2_rle_crop_3905824079_0.png treat image : temp/1754560829_3760158_1375606022_0f440510c918c50b1086fe8337ec8d32_rle_crop_3905824080_0.png treat image : temp/1754560829_3760158_1375606022_0f440510c918c50b1086fe8337ec8d32_rle_crop_3905824081_0.png treat image : temp/1754560829_3760158_1375605997_5afab21883deefae2eab3b87ee64db38_rle_crop_3905824083_0.png treat image : temp/1754560829_3760158_1375605944_8f630c65a9c475ef6ecccb49b3895f4a_rle_crop_3905824086_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824091_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824092_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824093_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824094_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824095_0.png treat image : temp/1754560829_3760158_1375605498_4e35323182fc130f928b2c291ab7886b_rle_crop_3905824096_0.png treat image : temp/1754560829_3760158_1375605451_3f6be6e05dbb7510e028d49435d8e011_rle_crop_3905824099_0.png treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824100_0.png treat image : temp/1754560829_3760158_1375605403_bb543fb84989eb35b93772c782a32d3d_rle_crop_3905824103_0.png treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3_rle_crop_3905824105_0.png treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3_rle_crop_3905824106_0.png treat image : temp/1754560829_3760158_1375605260_7b16ee4c61d91c5aa03f4595668e44c3_rle_crop_3905824107_0.png treat image : temp/1754560829_3760158_1375605107_5de5d37866a775ddc7f3e9293471e5c8_rle_crop_3905824108_0.png treat image : temp/1754560829_3760158_1375605106_666d85f26bbf3996d84ab006f490f82b_rle_crop_3905824110_0.png treat image : temp/1754560829_3760158_1375605104_ef719f412761054a4a2acb24b35234af_rle_crop_3905824111_0.png treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824116_0.png treat image : temp/1754560829_3760158_1375605100_43f182c98036b48bcf2d4d66b38411f7_rle_crop_3905824118_0.png treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193_rle_crop_3905824121_0.png treat image : temp/1754560829_3760158_1375605091_ba77c3158e053a668c715a86641bf193_rle_crop_3905824122_0.png treat image : temp/1754560829_3760158_1375604754_d687ff11cc103e31862c74b616000a9c_rle_crop_3905824123_0.png treat image : temp/1754560829_3760158_1375604754_d687ff11cc103e31862c74b616000a9c_rle_crop_3905824124_0.png treat image : temp/1754560829_3760158_1375604731_2220fd369deab2624895ca2db6ccdc92_rle_crop_3905824127_0.png treat image : temp/1754560829_3760158_1375604709_54a3bb5a301b98553cda81526258b665_rle_crop_3905824128_0.png treat image : temp/1754560829_3760158_1375604683_ce51134acd377933c70b06feede81902_rle_crop_3905824130_0.png treat image : temp/1754560829_3760158_1375604657_dcc921973008013b0986bb617e267e3e_rle_crop_3905824132_0.png treat image : temp/1754560829_3760158_1375604612_ace30f7d096c8eaef5191c39582e431e_rle_crop_3905824133_0.png treat image : temp/1754560829_3760158_1375604292_e1f84ae5ed5930ccf817aea948005d12_rle_crop_3905824138_0.png treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c_rle_crop_3905824139_0.png treat image : temp/1754560829_3760158_1375604211_cf88e07519378120344203e7fb08858c_rle_crop_3905824141_0.png treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824142_0.png treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824143_0.png treat image : temp/1754560829_3760158_1375604174_0cb6d43f25a5fdea32c00bfd4e94831c_rle_crop_3905824146_0.png treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1_rle_crop_3905824148_0.png treat image : temp/1754560829_3760158_1375604136_ceb24f14d90388f91cbef8d852a0d8a1_rle_crop_3905824149_0.png treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824150_0.png treat image : temp/1754560829_3760158_1375604077_11ab47df82ca8bbea0b2d0b776ff25db_rle_crop_3905824152_0.png treat image : temp/1754560829_3760158_1375605097_6857e59b99fa598923d8a10c170cec1d_rle_crop_3905824119_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 120 time used for this insertion : 0.02528691291809082 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 120 time used for this insertion : 0.2706434726715088 save missing photos in datou_result : time spend for datou_step_exec : 8.391481876373291 time spend to save output : 0.30141377449035645 total time spend for step 7 : 8.692895650863647 step8:velours_tree Thu Aug 7 12:03:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10776543617248535 time spend to save output : 5.8650970458984375e-05 total time spend for step 8 : 0.10782408714294434 step9:send_mail_cod Thu Aug 7 12:03:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25774546_07-08-2025_12_03_59.pdf 25775308 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257753081754561039 25775309 change filename to text .change filename to text .change filename to text .imagette257753091754561039 25775310 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257753101754561039 25775312 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257753121754561041 25775313 imagette257753131754561042 25775314 imagette257753141754561042 25775315 imagette257753151754561042 25775316 imagette257753161754561042 25775317 imagette257753171754561043 25775318 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257753181754561043 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25774546 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25775308,25775309,25775310,25775312,25775313,25775314,25775315,25775316,25775317,25775318,25775319?tags=carton,autre,pet_clair,papier,flou,mal_croppe,pet_fonce,background,pehd,metal,environnement args[1375606598] : ((1375606598, -1.8950764656971055, 492688767), (1375606598, 0.39265733952123, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375606072] : ((1375606072, -2.748125220143486, 492609224), (1375606072, 0.5050259617463979, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375606046] : ((1375606046, -1.548749439824888, 492688767), (1375606046, 0.5251061127664082, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375606022] : ((1375606022, -1.9731732492390146, 492688767), (1375606022, 0.6082616103968856, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605997] : ((1375605997, -2.0293337673175493, 492609224), (1375605997, 0.4179568055682578, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605972] : ((1375605972, -2.4840263341478077, 492609224), (1375605972, 0.5611754824098713, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605944] : ((1375605944, -2.4689728375778452, 492609224), (1375605944, 0.678797736417613, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605498] : ((1375605498, -1.9214200034965099, 492688767), (1375605498, 0.4044898242478379, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605451] : ((1375605451, -1.9521064981268352, 492688767), (1375605451, 0.45898942873028165, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605403] : ((1375605403, -4.2892491601013685, 492609224), (1375605403, 0.4006228134249521, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605260] : ((1375605260, -2.145531073278135, 492609224), (1375605260, 0.45835512044125415, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605107] : ((1375605107, -2.6079540559090595, 492609224), (1375605107, 0.6804783611546625, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605106] : ((1375605106, -2.3046022194528155, 492609224), (1375605106, 0.7293481599907586, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605104] : ((1375605104, -1.9180495459431488, 492688767), (1375605104, 0.6670394660677031, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605100] : ((1375605100, -2.4647200849399375, 492609224), (1375605100, 0.6760605659106316, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605097] : ((1375605097, -1.8005678843680168, 492688767), (1375605097, 0.6535181124289581, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375605091] : ((1375605091, -2.22789755453314, 492609224), (1375605091, 0.44421603793279285, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604754] : ((1375604754, -2.432802766294573, 492609224), (1375604754, 0.8295132485640888, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604731] : ((1375604731, -2.2313398007754954, 492609224), (1375604731, 0.6155323474653857, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604709] : ((1375604709, -2.4029758162700925, 492609224), (1375604709, 0.7792381491208547, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604683] : ((1375604683, -2.347967652845112, 492609224), (1375604683, 0.5281238233839446, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604657] : ((1375604657, -2.921599714138635, 492609224), (1375604657, 0.649437732039985, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604612] : ((1375604612, -2.8820294888865865, 492609224), (1375604612, 0.6362997252669015, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604292] : ((1375604292, -2.8570896239753356, 492609224), (1375604292, 0.6112186536154932, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604241] : ((1375604241, -2.0690246654677105, 492609224), (1375604241, 0.6886359217370844, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604211] : ((1375604211, -2.2317727706726234, 492609224), (1375604211, 0.4659474920900552, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604174] : ((1375604174, -0.21261768047840762, 492688767), (1375604174, 0.48250385302999044, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604136] : ((1375604136, -1.9389699223498265, 492688767), (1375604136, 0.4585429023276948, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375604077] : ((1375604077, -2.452135194396545, 492609224), (1375604077, 0.4538512831034362, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com args[1375603379] : ((1375603379, -1.7138554838971372, 492688767), (1375603379, 0.5367115015003096, 2107752395), '0.23233583416005285') We are sending mail with results at report@fotonower.com refus_total : 0.23233583416005285 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25774546 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25774546_07-08-2025_12_03_59.pdf results_Auto_P25774546_07-08-2025_12_03_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25774546_07-08-2025_12_03_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25774546','results_Auto_P25774546_07-08-2025_12_03_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25774546_07-08-2025_12_03_59.pdf','pdf','','1.06','0.23233583416005285') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25774546

https://www.fotonower.com/image?json=false&list_photos_id=1375606598
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375606072
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375606046
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375606022
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605997
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605972
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605944
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605498
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605451
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605403
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605260
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605107
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605106
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605104
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605100
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605097
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375605091
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604754
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604731
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604709
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604683
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604657
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604612
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604292
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604241
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604211
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604174
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604136
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375604077
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375603379
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 23.23%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25775308?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25775309?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25775310?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25775312?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25775318?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25774546_07-08-2025_12_03_59.pdf.

Lien vers velours :https://www.fotonower.com/velours/25775308,25775309,25775310,25775312,25775313,25775314,25775315,25775316,25775317,25775318,25775319?tags=carton,autre,pet_clair,papier,flou,mal_croppe,pet_fonce,background,pehd,metal,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 07 Aug 2025 10:04:06 GMT Content-Length: 0 Connection: close X-Message-Id: 2JG534ouT9-hQNrLiCfCQg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375606598, 1375606072, 1375606046, 1375606022, 1375605997, 1375605972, 1375605944, 1375605498, 1375605451, 1375605403, 1375605260, 1375605107, 1375605106, 1375605104, 1375605100, 1375605097, 1375605091, 1375604754, 1375604731, 1375604709, 1375604683, 1375604657, 1375604612, 1375604292, 1375604241, 1375604211, 1375604174, 1375604136, 1375604077, 1375603379] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606598', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606072', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606046', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606022', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605997', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605972', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605944', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605498', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605451', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605403', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605260', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605107', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605106', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605104', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605100', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605097', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605091', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604754', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604731', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604709', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604683', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604657', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604612', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604292', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604241', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604211', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604174', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604136', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604077', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375603379', None, None, None, None, None, '3474296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.021561622619628906 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.942646265029907 time spend to save output : 0.021981239318847656 total time spend for step 9 : 6.964627504348755 step10:split_time_score Thu Aug 7 12:04:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 70),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07082025 25774546 Nombre de photos uploadées : 70 / 23040 (0%) 07082025 25774546 Nombre de photos taguées (types de déchets): 0 / 70 (0%) 07082025 25774546 Nombre de photos taguées (volume) : 0 / 70 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.33514404296875e-05 ?????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0018715858459472656 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22300243377685547 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.21000337577160494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25764703_07-08-2025_08_21_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25764703 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25764703 AND mptpi.`type`=3594 To do Qualite : 0.1496234918630752 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25764707_07-08-2025_07_51_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25764707 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25764707 AND mptpi.`type`=3594 To do Qualite : 0.02979606722608024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25771298_07-08-2025_10_12_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25771298 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25771298 AND mptpi.`type`=3594 To do Qualite : 0.21791642554012344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25774546_07-08-2025_12_03_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25774546 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25774546 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25774548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25774550 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07082025': {'nb_upload': 70, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375606598, 1375606072, 1375606046, 1375606022, 1375605997, 1375605972, 1375605944, 1375605498, 1375605451, 1375605403, 1375605260, 1375605107, 1375605106, 1375605104, 1375605100, 1375605097, 1375605091, 1375604754, 1375604731, 1375604709, 1375604683, 1375604657, 1375604612, 1375604292, 1375604241, 1375604211, 1375604174, 1375604136, 1375604077, 1375603379] Looping around the photos to save general results len do output : 1 /25774546Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606598', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606072', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606046', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375606022', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605997', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605972', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605944', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605498', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605451', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605403', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605260', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605107', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605106', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605104', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605100', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605097', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375605091', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604754', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604731', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604709', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604683', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604657', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604612', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604292', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604241', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604211', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604174', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604136', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375604077', None, None, None, None, None, '3474296') ('3318', None, None, None, None, None, None, None, '3474296') ('3318', None, '1375603379', None, None, None, None, None, '3474296') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 31 time used for this insertion : 0.09381818771362305 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7019736766815186 time spend to save output : 0.09418988227844238 total time spend for step 10 : 2.796163558959961 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 30 set_done_treatment 140.82user 39.94system 3:43.32elapsed 80%CPU (0avgtext+0avgdata 3189736maxresident)k 280848inputs+103264outputs (418major+3033188minor)pagefaults 0swaps