python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1945329 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4025857'] with mtr_portfolio_ids : ['28381336'] and first list_photo_ids : [] new path : /proc/1945329/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 22 ; length of list_pids : 22 ; length of list_args : 22 time to download the photos : 2.818462371826172 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Nov 10 09:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-10 09:30:33.326061: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-10 09:30:33.350456: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-10 09:30:33.352043: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f73b4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-10 09:30:33.352071: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-10 09:30:33.355264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-10 09:30:33.606152: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2f7b6980 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-10 09:30:33.606197: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-10 09:30:33.607163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-10 09:30:33.607473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 09:30:33.615065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 09:30:33.617203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-10 09:30:33.617912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-10 09:30:33.620566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-10 09:30:33.621632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-10 09:30:33.627097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-10 09:30:33.628555: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-10 09:30:33.628635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 09:30:33.629379: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-10 09:30:33.629395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-10 09:30:33.629404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-10 09:30:33.630719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-10 09:30:33.907375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-10 09:30:33.907486: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 09:30:33.907511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 09:30:33.907534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-10 09:30:33.907555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-10 09:30:33.907576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-10 09:30:33.907596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-10 09:30:33.907618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-10 09:30:33.909234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-10 09:30:33.910761: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-10 09:30:33.910820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 09:30:33.910840: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 09:30:33.910858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-10 09:30:33.910875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-10 09:30:33.910892: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-10 09:30:33.910909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-10 09:30:33.910927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-10 09:30:33.912536: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-10 09:30:33.912568: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-10 09:30:33.912579: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-10 09:30:33.912685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-10 09:30:33.914164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-10 09:30:43.035868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 09:30:43.242895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 22 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 55.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 56.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 61.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1945900 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 tf kernel not reseted sub process len(results) : 22 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 22 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10774 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 5198 time to create 1 rle with old method : 0.006147623062133789 length of segment : 102 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 4858 time to create 1 rle with old method : 0.005509853363037109 length of segment : 170 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 13927 time to create 1 rle with old method : 0.01609182357788086 length of segment : 279 time for calcul the mask position with numpy : 0.0001430511474609375 nb_pixel_total : 5214 time to create 1 rle with old method : 0.006266355514526367 length of segment : 101 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 1764 time to create 1 rle with old method : 0.0028886795043945312 length of segment : 43 time for calcul the mask position with numpy : 0.000293731689453125 nb_pixel_total : 13471 time to create 1 rle with old method : 0.019656896591186523 length of segment : 203 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 4527 time to create 1 rle with old method : 0.005372762680053711 length of segment : 82 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 10808 time to create 1 rle with old method : 0.012701749801635742 length of segment : 150 time for calcul the mask position with numpy : 0.00015783309936523438 nb_pixel_total : 8496 time to create 1 rle with old method : 0.009822845458984375 length of segment : 120 time for calcul the mask position with numpy : 0.0006036758422851562 nb_pixel_total : 30012 time to create 1 rle with old method : 0.03274416923522949 length of segment : 414 time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 12246 time to create 1 rle with old method : 0.013927459716796875 length of segment : 149 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 14375 time to create 1 rle with old method : 0.016224384307861328 length of segment : 141 time for calcul the mask position with numpy : 0.0007131099700927734 nb_pixel_total : 52401 time to create 1 rle with old method : 0.05836772918701172 length of segment : 267 time for calcul the mask position with numpy : 0.001829385757446289 nb_pixel_total : 119831 time to create 1 rle with old method : 0.1282508373260498 length of segment : 597 time for calcul the mask position with numpy : 0.00048160552978515625 nb_pixel_total : 30030 time to create 1 rle with old method : 0.03319072723388672 length of segment : 317 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 3680 time to create 1 rle with old method : 0.0044825077056884766 length of segment : 49 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 4551 time to create 1 rle with old method : 0.0052416324615478516 length of segment : 74 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 5256 time to create 1 rle with old method : 0.006192445755004883 length of segment : 105 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 2111 time to create 1 rle with old method : 0.0026297569274902344 length of segment : 42 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 6820 time to create 1 rle with old method : 0.007822275161743164 length of segment : 121 time for calcul the mask position with numpy : 0.0014388561248779297 nb_pixel_total : 118750 time to create 1 rle with old method : 0.12702298164367676 length of segment : 551 time for calcul the mask position with numpy : 0.011261701583862305 nb_pixel_total : 749613 time to create 1 rle with new method : 0.03775358200073242 length of segment : 1127 time for calcul the mask position with numpy : 0.00014829635620117188 nb_pixel_total : 6577 time to create 1 rle with old method : 0.0076334476470947266 length of segment : 136 time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 11151 time to create 1 rle with old method : 0.012705564498901367 length of segment : 148 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 5653 time to create 1 rle with old method : 0.006631135940551758 length of segment : 80 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 5072 time to create 1 rle with old method : 0.005829811096191406 length of segment : 100 time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 4304 time to create 1 rle with old method : 0.0049550533294677734 length of segment : 52 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 3695 time to create 1 rle with old method : 0.004286527633666992 length of segment : 59 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 1842 time to create 1 rle with old method : 0.0021505355834960938 length of segment : 44 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 25547 time to create 1 rle with old method : 0.027922391891479492 length of segment : 166 time for calcul the mask position with numpy : 0.0007898807525634766 nb_pixel_total : 33641 time to create 1 rle with old method : 0.03800010681152344 length of segment : 233 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 6621 time to create 1 rle with old method : 0.007441043853759766 length of segment : 115 time for calcul the mask position with numpy : 0.0002727508544921875 nb_pixel_total : 3409 time to create 1 rle with old method : 0.003869771957397461 length of segment : 126 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 5185 time to create 1 rle with old method : 0.0057981014251708984 length of segment : 83 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 4741 time to create 1 rle with old method : 0.00559687614440918 length of segment : 78 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 6063 time to create 1 rle with old method : 0.006888628005981445 length of segment : 91 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 11158 time to create 1 rle with old method : 0.012897491455078125 length of segment : 140 time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 5739 time to create 1 rle with old method : 0.006594657897949219 length of segment : 99 time for calcul the mask position with numpy : 0.000263214111328125 nb_pixel_total : 8574 time to create 1 rle with old method : 0.009705543518066406 length of segment : 121 time for calcul the mask position with numpy : 0.002142190933227539 nb_pixel_total : 103390 time to create 1 rle with old method : 0.11268877983093262 length of segment : 527 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 6278 time to create 1 rle with old method : 0.007254362106323242 length of segment : 128 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 19497 time to create 1 rle with old method : 0.022661209106445312 length of segment : 119 time for calcul the mask position with numpy : 0.002489328384399414 nb_pixel_total : 108559 time to create 1 rle with old method : 0.11912369728088379 length of segment : 550 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 4058 time to create 1 rle with old method : 0.004915714263916016 length of segment : 58 time for calcul the mask position with numpy : 0.0033113956451416016 nb_pixel_total : 113352 time to create 1 rle with old method : 0.13102006912231445 length of segment : 521 time for calcul the mask position with numpy : 0.021391630172729492 nb_pixel_total : 1155203 time to create 1 rle with new method : 0.5029358863830566 length of segment : 1550 time for calcul the mask position with numpy : 0.00023126602172851562 nb_pixel_total : 3509 time to create 1 rle with old method : 0.003804445266723633 length of segment : 86 time for calcul the mask position with numpy : 0.00018715858459472656 nb_pixel_total : 3617 time to create 1 rle with old method : 0.003971576690673828 length of segment : 71 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 3441 time to create 1 rle with old method : 0.003946781158447266 length of segment : 56 time for calcul the mask position with numpy : 0.0008440017700195312 nb_pixel_total : 32985 time to create 1 rle with old method : 0.03453421592712402 length of segment : 238 time for calcul the mask position with numpy : 0.00183868408203125 nb_pixel_total : 89573 time to create 1 rle with old method : 0.09433317184448242 length of segment : 275 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 9225 time to create 1 rle with old method : 0.010174036026000977 length of segment : 239 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 1710 time to create 1 rle with old method : 0.0019905567169189453 length of segment : 41 time for calcul the mask position with numpy : 0.0029344558715820312 nb_pixel_total : 113875 time to create 1 rle with old method : 0.11991071701049805 length of segment : 561 time for calcul the mask position with numpy : 0.00036215782165527344 nb_pixel_total : 3028 time to create 1 rle with old method : 0.0038547515869140625 length of segment : 48 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 12060 time to create 1 rle with old method : 0.013749122619628906 length of segment : 195 time for calcul the mask position with numpy : 0.010408639907836914 nb_pixel_total : 620915 time to create 1 rle with new method : 0.03795480728149414 length of segment : 957 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 6381 time to create 1 rle with old method : 0.00707697868347168 length of segment : 166 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 5227 time to create 1 rle with old method : 0.006011486053466797 length of segment : 109 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 3803 time to create 1 rle with old method : 0.0045049190521240234 length of segment : 66 time for calcul the mask position with numpy : 0.001986265182495117 nb_pixel_total : 102427 time to create 1 rle with old method : 0.11082744598388672 length of segment : 523 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 2430 time to create 1 rle with old method : 0.0029239654541015625 length of segment : 57 time for calcul the mask position with numpy : 0.013531684875488281 nb_pixel_total : 987146 time to create 1 rle with new method : 0.03167724609375 length of segment : 1681 time spent for convertir_results : 4.464693784713745 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 63 chid ids of type : 3594 Number RLEs to save : 15897 save missing photos in datou_result : time spend for datou_step_exec : 31.83538842201233 time spend to save output : 1.0130817890167236 total time spend for step 1 : 32.84847021102905 step2:crop_condition Mon Nov 10 09:31:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 22 ! batch 1 Loaded 63 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3736932 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762763468_1945329 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144617_0.png', 0, 94, 102, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144618_0.png', 0, 53, 139, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144620_0.png', 0, 94, 101, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144621_0.png', 0, 54, 43, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144622_0.png', 0, 109, 161, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144624_0.png', 0, 102, 146, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144625_0.png', 0, 107, 117, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144627_0.png', 0, 144, 143, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144628_0.png', 0, 139, 136, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144629_0.png', 0, 316, 243, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48_rle_crop_4029144632_0.png', 0, 92, 48, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144634_0.png', 0, 95, 105, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144635_0.png', 0, 65, 42, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144636_0.png', 0, 110, 92, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144638_0.png', 0, 1147, 863, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144641_0.png', 0, 91, 78, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144642_0.png', 0, 93, 100, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144643_0.png', 0, 90, 51, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144644_0.png', 0, 79, 59, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144645_0.png', 0, 61, 37, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144648_0.png', 0, 88, 115, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144649_0.png', 0, 66, 125, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144650_0.png', 0, 106, 83, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144651_0.png', 0, 92, 77, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144652_0.png', 0, 103, 90, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144653_0.png', 0, 176, 140, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692108_73b3224e86e1bc87797bfbd3707285c1_rle_crop_4029144654_0.png', 0, 78, 99, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144655_0.png', 0, 103, 119, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144657_0.png', 0, 113, 105, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144660_0.png', 0, 81, 58, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144663_0.png', 0, 60, 86, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144664_0.png', 0, 66, 71, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144665_0.png', 0, 85, 56, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144667_0.png', 0, 474, 263, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144668_0.png', 0, 118, 142, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144669_0.png', 0, 57, 40, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692045_83f4ecf117cfc67b49575a0bfe53cf7f_rle_crop_4029144671_0.png', 0, 94, 46, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691741_26573bc0aef2edcdc4678818137a1f84_rle_crop_4029144672_0.png', 0, 125, 177, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35_rle_crop_4029144674_0.png', 0, 72, 166, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144675_0.png', 0, 92, 109, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763477), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144678_0.png', 0, 70, 57, 0, 1762763477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 41 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.560251712799072 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762763480_1945329 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763481), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144623_0.png', 0, 74, 82, 0, 1762763481,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763481), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144637_0.png', 0, 354, 549, 0, 1762763481,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763481), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144640_0.png', 0, 113, 137, 0, 1762763481,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763481), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144676_0.png', 0, 80, 65, 0, 1762763481,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5556867122650146 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762763482_1945329 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763482), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48_rle_crop_4029144633_0.png', 0, 78, 72, 0, 1762763482,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5135314464569092 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762763497_1945329 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144630_0.png', 0, 350, 590, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144639_0.png', 0, 118, 93, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144646_0.png', 0, 214, 145, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144647_0.png', 0, 315, 179, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144656_0.png', 0, 321, 527, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144658_0.png', 0, 221, 118, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144659_0.png', 0, 326, 541, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430_rle_crop_4029144661_0.png', 0, 333, 521, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430_rle_crop_4029144662_0.png', 0, 1368, 998, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144666_0.png', 0, 211, 220, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144670_0.png', 0, 330, 561, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35_rle_crop_4029144673_0.png', 0, 959, 931, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144677_0.png', 0, 313, 518, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763499), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144679_0.png', 0, 1345, 974, 0, 1762763499,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.656834840774536 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762763501_1945329 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763502), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144619_0.png', 0, 90, 228, 0, 1762763502,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763502), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144626_0.png', 0, 146, 414, 0, 1762763502,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762763502), 0.0, 0.0, 14, '', 0, 0, '1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144631_0.png', 0, 158, 290, 0, 1762763502,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0390899181365967 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393692262, 1393692259, 1393692184, 1393692182, 1393692179, 1393692176, 1393692172, 1393692128, 1393692122, 1393692108, 1393692103, 1393692054, 1393692053, 1393692051, 1393692049, 1393692045, 1393691775, 1393691749, 1393691741, 1393691702, 1393691667, 1393691465] Looping around the photos to save general results len do output : 63 /1393693458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393693535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692262', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692259', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692184', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692182', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692179', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692176', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692172', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692128', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692122', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692108', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692103', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692054', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692053', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692051', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692049', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692045', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691775', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691749', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691741', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691702', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691667', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691465', None, None, None, None, None, '4025857') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 211 time used for this insertion : 0.04170727729797363 save_final save missing photos in datou_result : time spend for datou_step_exec : 38.85337686538696 time spend to save output : 0.04419207572937012 total time spend for step 2 : 38.89756894111633 step3:rle_unique_nms_with_priority Mon Nov 10 09:31:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 63 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.3473498821258545 time for calcul the mask position with numpy : 0.13201022148132324 nb_pixel_total : 2049617 time to create 1 rle with new method : 0.1917412281036377 time for calcul the mask position with numpy : 0.006651401519775391 nb_pixel_total : 13927 time to create 1 rle with old method : 0.015316963195800781 time for calcul the mask position with numpy : 0.00633692741394043 nb_pixel_total : 4858 time to create 1 rle with old method : 0.005331993103027344 time for calcul the mask position with numpy : 0.0064237117767333984 nb_pixel_total : 5198 time to create 1 rle with old method : 0.006661653518676758 create new chi : 0.3805580139160156 time to delete rle : 0.021187782287597656 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2182 TO DO : save crop sub photo not yet done ! save time : 0.1811666488647461 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.15497398376464844 time for calcul the mask position with numpy : 0.057201385498046875 nb_pixel_total : 2048624 time to create 1 rle with new method : 0.1799914836883545 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 4527 time to create 1 rle with old method : 0.006760120391845703 time for calcul the mask position with numpy : 0.006651163101196289 nb_pixel_total : 13471 time to create 1 rle with old method : 0.022055625915527344 time for calcul the mask position with numpy : 0.006543874740600586 nb_pixel_total : 1764 time to create 1 rle with old method : 0.0029113292694091797 time for calcul the mask position with numpy : 0.006470441818237305 nb_pixel_total : 5214 time to create 1 rle with old method : 0.00854039192199707 create new chi : 0.3127286434173584 time to delete rle : 0.0004222393035888672 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1938 TO DO : save crop sub photo not yet done ! save time : 0.15370488166809082 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.048395395278930664 time for calcul the mask position with numpy : 0.1689004898071289 nb_pixel_total : 2024284 time to create 1 rle with new method : 0.08721756935119629 time for calcul the mask position with numpy : 0.006201982498168945 nb_pixel_total : 30012 time to create 1 rle with old method : 0.0355219841003418 time for calcul the mask position with numpy : 0.005925178527832031 nb_pixel_total : 8496 time to create 1 rle with old method : 0.009442329406738281 time for calcul the mask position with numpy : 0.005917787551879883 nb_pixel_total : 10808 time to create 1 rle with old method : 0.011719465255737305 create new chi : 0.33957862854003906 time to delete rle : 0.00041103363037109375 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2448 TO DO : save crop sub photo not yet done ! save time : 0.18600988388061523 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.2968423366546631 time for calcul the mask position with numpy : 0.06322646141052246 nb_pixel_total : 1850045 time to create 1 rle with new method : 0.07991552352905273 time for calcul the mask position with numpy : 0.006098270416259766 nb_pixel_total : 30030 time to create 1 rle with old method : 0.03175544738769531 time for calcul the mask position with numpy : 0.0065271854400634766 nb_pixel_total : 119831 time to create 1 rle with old method : 0.12891006469726562 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 47073 time to create 1 rle with old method : 0.05176877975463867 time for calcul the mask position with numpy : 0.0062716007232666016 nb_pixel_total : 14375 time to create 1 rle with old method : 0.01626110076904297 time for calcul the mask position with numpy : 0.006732463836669922 nb_pixel_total : 12246 time to create 1 rle with old method : 0.013846635818481445 create new chi : 0.42750072479248047 time to delete rle : 0.0006401538848876953 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3894 TO DO : save crop sub photo not yet done ! save time : 0.2788882255554199 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.042884111404418945 time for calcul the mask position with numpy : 0.019637346267700195 nb_pixel_total : 2065369 time to create 1 rle with new method : 0.11601018905639648 time for calcul the mask position with numpy : 0.005944967269897461 nb_pixel_total : 4551 time to create 1 rle with old method : 0.0050165653228759766 time for calcul the mask position with numpy : 0.005915403366088867 nb_pixel_total : 3680 time to create 1 rle with old method : 0.004055023193359375 create new chi : 0.15682363510131836 time to delete rle : 0.0002486705780029297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1326 TO DO : save crop sub photo not yet done ! save time : 0.11671566963195801 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.1717984676361084 time for calcul the mask position with numpy : 0.035514116287231445 nb_pixel_total : 1184987 time to create 1 rle with new method : 0.20075511932373047 time for calcul the mask position with numpy : 0.006356716156005859 nb_pixel_total : 6577 time to create 1 rle with old method : 0.007009267807006836 time for calcul the mask position with numpy : 0.010869026184082031 nb_pixel_total : 749542 time to create 1 rle with new method : 0.17251086235046387 time for calcul the mask position with numpy : 0.006196260452270508 nb_pixel_total : 118499 time to create 1 rle with old method : 0.1252002716064453 time for calcul the mask position with numpy : 0.005884647369384766 nb_pixel_total : 6628 time to create 1 rle with old method : 0.0071277618408203125 time for calcul the mask position with numpy : 0.005765199661254883 nb_pixel_total : 2111 time to create 1 rle with old method : 0.002282857894897461 time for calcul the mask position with numpy : 0.005575895309448242 nb_pixel_total : 5256 time to create 1 rle with old method : 0.0054132938385009766 create new chi : 0.6114983558654785 time to delete rle : 0.0007383823394775391 batch 1 Loaded 14 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 5192 TO DO : save crop sub photo not yet done ! save time : 0.3420257568359375 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.07485508918762207 time for calcul the mask position with numpy : 0.0972740650177002 nb_pixel_total : 2027487 time to create 1 rle with new method : 0.0773930549621582 time for calcul the mask position with numpy : 0.0064432621002197266 nb_pixel_total : 25547 time to create 1 rle with old method : 0.028313875198364258 time for calcul the mask position with numpy : 0.006300210952758789 nb_pixel_total : 1842 time to create 1 rle with old method : 0.002096414566040039 time for calcul the mask position with numpy : 0.006081104278564453 nb_pixel_total : 3695 time to create 1 rle with old method : 0.0039768218994140625 time for calcul the mask position with numpy : 0.006508350372314453 nb_pixel_total : 4304 time to create 1 rle with old method : 0.004610538482666016 time for calcul the mask position with numpy : 0.006745338439941406 nb_pixel_total : 5072 time to create 1 rle with old method : 0.005660295486450195 time for calcul the mask position with numpy : 0.0063779354095458984 nb_pixel_total : 5653 time to create 1 rle with old method : 0.006301403045654297 create new chi : 0.27365636825561523 time to delete rle : 0.00041365623474121094 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2082 TO DO : save crop sub photo not yet done ! save time : 0.16833806037902832 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.049623727798461914 time for calcul the mask position with numpy : 0.018996238708496094 nb_pixel_total : 2029929 time to create 1 rle with new method : 0.14421296119689941 time for calcul the mask position with numpy : 0.006176471710205078 nb_pixel_total : 3409 time to create 1 rle with old method : 0.003777027130126953 time for calcul the mask position with numpy : 0.006539106369018555 nb_pixel_total : 6621 time to create 1 rle with old method : 0.007167816162109375 time for calcul the mask position with numpy : 0.006459236145019531 nb_pixel_total : 33641 time to create 1 rle with old method : 0.04242396354675293 create new chi : 0.23613476753234863 time to delete rle : 0.00034809112548828125 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2028 TO DO : save crop sub photo not yet done ! save time : 0.16719341278076172 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.07845306396484375 time for calcul the mask position with numpy : 0.020214557647705078 nb_pixel_total : 2046453 time to create 1 rle with new method : 0.13216137886047363 time for calcul the mask position with numpy : 0.005926370620727539 nb_pixel_total : 11158 time to create 1 rle with old method : 0.011821985244750977 time for calcul the mask position with numpy : 0.005784273147583008 nb_pixel_total : 6063 time to create 1 rle with old method : 0.0064699649810791016 time for calcul the mask position with numpy : 0.006119251251220703 nb_pixel_total : 4741 time to create 1 rle with old method : 0.005300283432006836 time for calcul the mask position with numpy : 0.005904197692871094 nb_pixel_total : 5185 time to create 1 rle with old method : 0.005563974380493164 create new chi : 0.2124946117401123 time to delete rle : 0.00033736228942871094 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1864 TO DO : save crop sub photo not yet done ! save time : 0.14270472526550293 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03225088119506836 time for calcul the mask position with numpy : 0.018732786178588867 nb_pixel_total : 2067861 time to create 1 rle with new method : 0.05447506904602051 time for calcul the mask position with numpy : 0.005807161331176758 nb_pixel_total : 5739 time to create 1 rle with old method : 0.006452083587646484 create new chi : 0.08569049835205078 time to delete rle : 0.00020575523376464844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1278 TO DO : save crop sub photo not yet done ! save time : 0.12640023231506348 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.1953883171081543 time for calcul the mask position with numpy : 0.0956730842590332 nb_pixel_total : 1955358 time to create 1 rle with new method : 0.14407706260681152 time for calcul the mask position with numpy : 0.005890846252441406 nb_pixel_total : 6278 time to create 1 rle with old method : 0.006888151168823242 time for calcul the mask position with numpy : 0.00699305534362793 nb_pixel_total : 103390 time to create 1 rle with old method : 0.10856938362121582 time for calcul the mask position with numpy : 0.005985260009765625 nb_pixel_total : 8574 time to create 1 rle with old method : 0.00938725471496582 create new chi : 0.3970777988433838 time to delete rle : 0.00045228004455566406 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 2632 TO DO : save crop sub photo not yet done ! save time : 0.19501233100891113 No data in photo_id : 1393692054 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05054330825805664 time for calcul the mask position with numpy : 0.11547398567199707 nb_pixel_total : 1941486 time to create 1 rle with new method : 0.08851838111877441 time for calcul the mask position with numpy : 0.006304264068603516 nb_pixel_total : 4058 time to create 1 rle with old method : 0.004544496536254883 time for calcul the mask position with numpy : 0.006483316421508789 nb_pixel_total : 108559 time to create 1 rle with old method : 0.12226462364196777 time for calcul the mask position with numpy : 0.005899906158447266 nb_pixel_total : 19497 time to create 1 rle with old method : 0.02121710777282715 create new chi : 0.381986141204834 time to delete rle : 0.0004487037658691406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2534 TO DO : save crop sub photo not yet done ! save time : 0.1977090835571289 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04631972312927246 time for calcul the mask position with numpy : 0.011418342590332031 nb_pixel_total : 805045 time to create 1 rle with new method : 0.125654935836792 time for calcul the mask position with numpy : 0.013573646545410156 nb_pixel_total : 1155203 time to create 1 rle with new method : 0.02842569351196289 time for calcul the mask position with numpy : 0.0068035125732421875 nb_pixel_total : 113352 time to create 1 rle with old method : 0.12200355529785156 create new chi : 0.30858683586120605 time to delete rle : 0.0007617473602294922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 5222 TO DO : save crop sub photo not yet done ! save time : 0.3267698287963867 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.2891991138458252 time for calcul the mask position with numpy : 0.08840441703796387 nb_pixel_total : 1817507 time to create 1 rle with new method : 0.07620000839233398 time for calcul the mask position with numpy : 0.0065288543701171875 nb_pixel_total : 113875 time to create 1 rle with old method : 0.11870217323303223 time for calcul the mask position with numpy : 0.0059010982513427734 nb_pixel_total : 1710 time to create 1 rle with old method : 0.0018301010131835938 time for calcul the mask position with numpy : 0.005721330642700195 nb_pixel_total : 7383 time to create 1 rle with old method : 0.008395910263061523 time for calcul the mask position with numpy : 0.006327629089355469 nb_pixel_total : 89573 time to create 1 rle with old method : 0.09625864028930664 time for calcul the mask position with numpy : 0.006263017654418945 nb_pixel_total : 32985 time to create 1 rle with old method : 0.03566098213195801 time for calcul the mask position with numpy : 0.006061077117919922 nb_pixel_total : 3441 time to create 1 rle with old method : 0.0037126541137695312 time for calcul the mask position with numpy : 0.005944967269897461 nb_pixel_total : 3617 time to create 1 rle with old method : 0.0038988590240478516 time for calcul the mask position with numpy : 0.005907535552978516 nb_pixel_total : 3509 time to create 1 rle with old method : 0.0037086009979248047 create new chi : 0.49611496925354004 time to delete rle : 0.0006873607635498047 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 4037 TO DO : save crop sub photo not yet done ! save time : 0.2742617130279541 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03261685371398926 time for calcul the mask position with numpy : 0.01902627944946289 nb_pixel_total : 2070572 time to create 1 rle with new method : 0.030373573303222656 time for calcul the mask position with numpy : 0.006559848785400391 nb_pixel_total : 3028 time to create 1 rle with old method : 0.005163669586181641 create new chi : 0.06996893882751465 time to delete rle : 0.0002713203430175781 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1176 TO DO : save crop sub photo not yet done ! save time : 0.10432100296020508 No data in photo_id : 1393691775 No data in photo_id : 1393691749 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.12978053092956543 time for calcul the mask position with numpy : 0.1048426628112793 nb_pixel_total : 2061540 time to create 1 rle with new method : 0.0795435905456543 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 12060 time to create 1 rle with old method : 0.012798070907592773 create new chi : 0.21393799781799316 time to delete rle : 0.00023245811462402344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1470 TO DO : save crop sub photo not yet done ! save time : 0.12047028541564941 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.13336491584777832 time for calcul the mask position with numpy : 0.04651474952697754 nb_pixel_total : 1446304 time to create 1 rle with new method : 0.11597990989685059 time for calcul the mask position with numpy : 0.00618433952331543 nb_pixel_total : 6381 time to create 1 rle with old method : 0.007172822952270508 time for calcul the mask position with numpy : 0.010371685028076172 nb_pixel_total : 620915 time to create 1 rle with new method : 0.10391497611999512 create new chi : 0.30043673515319824 time to delete rle : 0.0004820823669433594 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 3326 TO DO : save crop sub photo not yet done ! save time : 0.24207544326782227 No data in photo_id : 1393691667 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.31392741203308105 time for calcul the mask position with numpy : 0.08118510246276855 nb_pixel_total : 976370 time to create 1 rle with new method : 0.09640979766845703 time for calcul the mask position with numpy : 0.017862558364868164 nb_pixel_total : 983343 time to create 1 rle with new method : 0.1506357192993164 time for calcul the mask position with numpy : 0.006468534469604492 nb_pixel_total : 2430 time to create 1 rle with old method : 0.0029184818267822266 time for calcul the mask position with numpy : 0.0067517757415771484 nb_pixel_total : 102427 time to create 1 rle with old method : 0.11069846153259277 time for calcul the mask position with numpy : 0.010773658752441406 nb_pixel_total : 3803 time to create 1 rle with old method : 0.004306793212890625 time for calcul the mask position with numpy : 0.00660252571105957 nb_pixel_total : 5227 time to create 1 rle with old method : 0.005922555923461914 create new chi : 0.5213561058044434 time to delete rle : 0.0010089874267578125 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5952 TO DO : save crop sub photo not yet done ! save time : 0.3875601291656494 map_output_result : {1393692262: (0.0, 'Should be the crop_list due to order', 0), 1393692259: (0.0, 'Should be the crop_list due to order', 0), 1393692184: (0.0, 'Should be the crop_list due to order', 0), 1393692182: (0.0, 'Should be the crop_list due to order', 0), 1393692179: (0.0, 'Should be the crop_list due to order', 0), 1393692176: (0.0, 'Should be the crop_list due to order', 0), 1393692172: (0.0, 'Should be the crop_list due to order', 0), 1393692128: (0.0, 'Should be the crop_list due to order', 0), 1393692122: (0.0, 'Should be the crop_list due to order', 0), 1393692108: (0.0, 'Should be the crop_list due to order', 0), 1393692103: (0.0, 'Should be the crop_list due to order', 0), 1393692054: (0.0, 'Should be the crop_list due to order', 0.0), 1393692053: (0.0, 'Should be the crop_list due to order', 0), 1393692051: (0.0, 'Should be the crop_list due to order', 0), 1393692049: (0.0, 'Should be the crop_list due to order', 0), 1393692045: (0.0, 'Should be the crop_list due to order', 0), 1393691775: (0.0, 'Should be the crop_list due to order', 0.0), 1393691749: (0.0, 'Should be the crop_list due to order', 0.0), 1393691741: (0.0, 'Should be the crop_list due to order', 0), 1393691702: (0.0, 'Should be the crop_list due to order', 0), 1393691667: (0.0, 'Should be the crop_list due to order', 0.0), 1393691465: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393692262, 1393692259, 1393692184, 1393692182, 1393692179, 1393692176, 1393692172, 1393692128, 1393692122, 1393692108, 1393692103, 1393692054, 1393692053, 1393692051, 1393692049, 1393692045, 1393691775, 1393691749, 1393691741, 1393691702, 1393691667, 1393691465] Looping around the photos to save general results len do output : 22 /1393692262.Didn't retrieve data . /1393692259.Didn't retrieve data . /1393692184.Didn't retrieve data . /1393692182.Didn't retrieve data . /1393692179.Didn't retrieve data . /1393692176.Didn't retrieve data . /1393692172.Didn't retrieve data . /1393692128.Didn't retrieve data . /1393692122.Didn't retrieve data . /1393692108.Didn't retrieve data . /1393692103.Didn't retrieve data . /1393692054.Didn't retrieve data . /1393692053.Didn't retrieve data . /1393692051.Didn't retrieve data . /1393692049.Didn't retrieve data . /1393692045.Didn't retrieve data . /1393691775.Didn't retrieve data . /1393691749.Didn't retrieve data . /1393691741.Didn't retrieve data . /1393691702.Didn't retrieve data . /1393691667.Didn't retrieve data . /1393691465.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692262', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692259', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692184', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692182', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692179', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692176', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692172', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692128', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692122', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692108', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692103', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692054', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692053', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692051', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692049', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692045', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691775', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691749', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691741', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691702', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691667', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691465', None, None, None, None, None, '4025857') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 66 time used for this insertion : 0.01745009422302246 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.537051916122437 time spend to save output : 0.01835775375366211 total time spend for step 3 : 12.555409669876099 step4:ventilate_hashtags_in_portfolio Mon Nov 10 09:31:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28381336 get user id for portfolio 28381336 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28381336 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pet_fonce','environnement','autre','mal_croppe','metal','pehd','papier','pet_clair','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28381336 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pet_fonce','environnement','autre','mal_croppe','metal','pehd','papier','pet_clair','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28381336 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pet_fonce','environnement','autre','mal_croppe','metal','pehd','papier','pet_clair','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28381415,28381416,28381417,28381418,28381419,28381420,28381421,28381422,28381423,28381424,28381425?tags=flou,carton,pet_fonce,environnement,autre,mal_croppe,metal,pehd,papier,pet_clair,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393692262, 1393692259, 1393692184, 1393692182, 1393692179, 1393692176, 1393692172, 1393692128, 1393692122, 1393692108, 1393692103, 1393692054, 1393692053, 1393692051, 1393692049, 1393692045, 1393691775, 1393691749, 1393691741, 1393691702, 1393691667, 1393691465] Looping around the photos to save general results len do output : 1 /28381336. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692262', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692259', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692184', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692182', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692179', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692176', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692172', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692128', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692122', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692108', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692103', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692054', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692053', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692051', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692049', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692045', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691775', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691749', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691741', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691702', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691667', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691465', None, None, None, None, None, '4025857') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.01833176612854004 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6684317588806152 time spend to save output : 0.018717527389526367 total time spend for step 4 : 1.6871492862701416 step5:final Mon Nov 10 09:31:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393692262: ('0.10644557554713807',), 1393692259: ('0.10644557554713807',), 1393692184: ('0.10644557554713807',), 1393692182: ('0.10644557554713807',), 1393692179: ('0.10644557554713807',), 1393692176: ('0.10644557554713807',), 1393692172: ('0.10644557554713807',), 1393692128: ('0.10644557554713807',), 1393692122: ('0.10644557554713807',), 1393692108: ('0.10644557554713807',), 1393692103: ('0.10644557554713807',), 1393692054: ('0.10644557554713807',), 1393692053: ('0.10644557554713807',), 1393692051: ('0.10644557554713807',), 1393692049: ('0.10644557554713807',), 1393692045: ('0.10644557554713807',), 1393691775: ('0.10644557554713807',), 1393691749: ('0.10644557554713807',), 1393691741: ('0.10644557554713807',), 1393691702: ('0.10644557554713807',), 1393691667: ('0.10644557554713807',), 1393691465: ('0.10644557554713807',)} new output for save of step final : {1393692262: ('0.10644557554713807',), 1393692259: ('0.10644557554713807',), 1393692184: ('0.10644557554713807',), 1393692182: ('0.10644557554713807',), 1393692179: ('0.10644557554713807',), 1393692176: ('0.10644557554713807',), 1393692172: ('0.10644557554713807',), 1393692128: ('0.10644557554713807',), 1393692122: ('0.10644557554713807',), 1393692108: ('0.10644557554713807',), 1393692103: ('0.10644557554713807',), 1393692054: ('0.10644557554713807',), 1393692053: ('0.10644557554713807',), 1393692051: ('0.10644557554713807',), 1393692049: ('0.10644557554713807',), 1393692045: ('0.10644557554713807',), 1393691775: ('0.10644557554713807',), 1393691749: ('0.10644557554713807',), 1393691741: ('0.10644557554713807',), 1393691702: ('0.10644557554713807',), 1393691667: ('0.10644557554713807',), 1393691465: ('0.10644557554713807',)} [1393692262, 1393692259, 1393692184, 1393692182, 1393692179, 1393692176, 1393692172, 1393692128, 1393692122, 1393692108, 1393692103, 1393692054, 1393692053, 1393692051, 1393692049, 1393692045, 1393691775, 1393691749, 1393691741, 1393691702, 1393691667, 1393691465] Looping around the photos to save general results len do output : 22 /1393692262.Didn't retrieve data . /1393692259.Didn't retrieve data . /1393692184.Didn't retrieve data . /1393692182.Didn't retrieve data . /1393692179.Didn't retrieve data . /1393692176.Didn't retrieve data . /1393692172.Didn't retrieve data . /1393692128.Didn't retrieve data . /1393692122.Didn't retrieve data . /1393692108.Didn't retrieve data . /1393692103.Didn't retrieve data . /1393692054.Didn't retrieve data . /1393692053.Didn't retrieve data . /1393692051.Didn't retrieve data . /1393692049.Didn't retrieve data . /1393692045.Didn't retrieve data . /1393691775.Didn't retrieve data . /1393691749.Didn't retrieve data . /1393691741.Didn't retrieve data . /1393691702.Didn't retrieve data . /1393691667.Didn't retrieve data . /1393691465.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692262', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692259', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692184', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692182', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692179', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692176', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692172', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692128', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692122', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692108', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692103', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692054', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692053', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692051', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692049', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692045', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691775', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691749', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691741', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691702', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691667', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691465', None, None, None, None, None, '4025857') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 66 time used for this insertion : 0.019243955612182617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11968493461608887 time spend to save output : 0.02030181884765625 total time spend for step 5 : 0.13998675346374512 step6:blur_detection Mon Nov 10 09:31:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5.jpg resize: (1080, 1920) 1393692262 1.1660232322191226 treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d.jpg resize: (1080, 1920) 1393692259 1.7205416180595825 treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0.jpg resize: (1080, 1920) 1393692184 -0.2578419401546765 treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a.jpg resize: (1080, 1920) 1393692182 -4.2910074176626 treat image : temp/1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48.jpg resize: (1080, 1920) 1393692179 -0.5305392789754215 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066.jpg resize: (1080, 1920) 1393692176 -4.261472783015251 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8.jpg resize: (1080, 1920) 1393692172 -0.5276135603493374 treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3.jpg resize: (1080, 1920) 1393692128 -4.105839526925994 treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4.jpg resize: (1080, 1920) 1393692122 0.21540962363511612 treat image : temp/1762763427_1945329_1393692108_73b3224e86e1bc87797bfbd3707285c1.jpg resize: (1080, 1920) 1393692108 -2.0313507574489114 treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8.jpg resize: (1080, 1920) 1393692103 -4.358398247217161 treat image : temp/1762763427_1945329_1393692054_21a768876706f5a468a8e2589c0b8261.jpg resize: (1080, 1920) 1393692054 1.403992483948128 treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702.jpg resize: (1080, 1920) 1393692053 -3.335390098315512 treat image : temp/1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430.jpg resize: (1080, 1920) 1393692051 1.111882358914231 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4.jpg resize: (1080, 1920) 1393692049 -2.690046392663344 treat image : temp/1762763427_1945329_1393692045_83f4ecf117cfc67b49575a0bfe53cf7f.jpg resize: (1080, 1920) 1393692045 0.044886554584438194 treat image : temp/1762763427_1945329_1393691775_257cf46eb98843b9394412301d0f840a.jpg resize: (1080, 1920) 1393691775 0.09905766204956526 treat image : temp/1762763427_1945329_1393691749_7e88a9e66561dca624e42a2791f0d28c.jpg resize: (1080, 1920) 1393691749 0.3032798263861863 treat image : temp/1762763427_1945329_1393691741_26573bc0aef2edcdc4678818137a1f84.jpg resize: (1080, 1920) 1393691741 0.3921152140527259 treat image : temp/1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35.jpg resize: (1080, 1920) 1393691702 0.5666891769889495 treat image : temp/1762763427_1945329_1393691667_47e0f32454d1d48c88a01d35e2280ea0.jpg resize: (1080, 1920) 1393691667 5.744555043915684 treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05.jpg resize: (1080, 1920) 1393691465 0.6401253193291694 treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144617_0.png resize: (102, 94) 1393693458 -1.9417180056442054 treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144618_0.png resize: (139, 53) 1393693459 -2.1052448181849046 treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144620_0.png resize: (101, 94) 1393693460 -2.0071449958048375 treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144621_0.png resize: (43, 54) 1393693461 20.0 treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144622_0.png resize: (161, 109) 1393693462 -1.3703652857416901 treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144624_0.png resize: (146, 102) 1393693463 0.07796535474682097 treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144625_0.png resize: (117, 107) 1393693464 -1.2063848686017316 treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144627_0.png resize: (143, 144) 1393693465 -2.837846640808717 treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144628_0.png resize: (136, 139) 1393693466 -5.309553738751765 treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144629_0.png resize: (243, 316) 1393693467 -5.193494789271362 treat image : temp/1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48_rle_crop_4029144632_0.png resize: (48, 92) 1393693468 4.549425946615504 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144634_0.png resize: (105, 95) 1393693469 -2.1653231637137456 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144635_0.png resize: (42, 65) 1393693470 -0.43155555494217046 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144636_0.png resize: (92, 110) 1393693471 -3.760498860897173 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144638_0.png resize: (863, 1147) 1393693472 -5.05774403334767 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144641_0.png resize: (78, 91) 1393693473 -0.15657054015773197 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144642_0.png resize: (100, 93) 1393693474 -2.062069365039517 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144643_0.png resize: (51, 90) 1393693475 9.032174260847365 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144644_0.png resize: (59, 79) 1393693476 2.2040492481125087 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144645_0.png resize: (37, 61) 1393693477 20.0 treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144648_0.png resize: (115, 88) 1393693478 -2.22012675862643 treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144649_0.png resize: (125, 66) 1393693479 -2.4967287366340245 treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144650_0.png resize: (83, 106) 1393693480 -0.5888515547249181 treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144651_0.png resize: (77, 92) 1393693482 -0.03141100348359915 treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144652_0.png resize: (90, 103) 1393693483 -1.4735703875310047 treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144653_0.png resize: (140, 176) 1393693484 -2.238160658942641 treat image : temp/1762763427_1945329_1393692108_73b3224e86e1bc87797bfbd3707285c1_rle_crop_4029144654_0.png resize: (99, 78) 1393693485 1.3131043738768606 treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144655_0.png resize: (119, 103) 1393693486 -2.37466524173853 treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144657_0.png resize: (105, 113) 1393693487 -3.82745159175306 treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144660_0.png resize: (58, 81) 1393693488 -1.5167050767441375 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144663_0.png resize: (86, 60) 1393693489 0.350225059321636 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144664_0.png resize: (71, 66) 1393693490 1.0042680091739844 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144665_0.png resize: (56, 85) 1393693491 -1.2680150383843471 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144667_0.png resize: (263, 474) 1393693492 -1.8795736035737967 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144668_0.png resize: (142, 118) 1393693493 -2.3169001614307394 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144669_0.png resize: (40, 57) 1393693494 3.877966859970182 treat image : temp/1762763427_1945329_1393692045_83f4ecf117cfc67b49575a0bfe53cf7f_rle_crop_4029144671_0.png resize: (46, 94) 1393693495 -0.10599945477035981 treat image : temp/1762763427_1945329_1393691741_26573bc0aef2edcdc4678818137a1f84_rle_crop_4029144672_0.png resize: (177, 125) 1393693496 -1.6106163128884217 treat image : temp/1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35_rle_crop_4029144674_0.png resize: (166, 72) 1393693497 -1.811230741045558 treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144675_0.png resize: (109, 92) 1393693498 -1.8590700915943428 treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144678_0.png resize: (57, 70) 1393693499 -2.0770710811327895 treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144623_0.png resize: (82, 74) 1393693501 -0.22841429776677058 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144637_0.png resize: (549, 354) 1393693502 0.29778815474686043 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144640_0.png resize: (137, 113) 1393693503 -1.136418254847636 treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144676_0.png resize: (65, 80) 1393693504 -0.269543265599401 treat image : temp/1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48_rle_crop_4029144633_0.png resize: (72, 78) 1393693506 1.0480215737351748 treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144630_0.png resize: (590, 350) 1393693518 0.051545164428331756 treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144639_0.png resize: (93, 118) 1393693519 -3.492597222132303 treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144646_0.png resize: (145, 214) 1393693520 -2.2268982037055167 treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144647_0.png resize: (179, 315) 1393693521 -3.5083433824676598 treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144656_0.png resize: (527, 321) 1393693522 0.07525122335940154 treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144658_0.png resize: (118, 221) 1393693523 -2.4574318391628904 treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144659_0.png resize: (541, 326) 1393693524 -0.14479225896608272 treat image : temp/1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430_rle_crop_4029144661_0.png resize: (521, 333) 1393693525 0.16551353461379933 treat image : temp/1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430_rle_crop_4029144662_0.png resize: (998, 1368) 1393693526 -0.8057066224013816 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144666_0.png resize: (220, 211) 1393693527 -2.8420905790078423 treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144670_0.png resize: (561, 330) 1393693528 0.37606031623861136 treat image : temp/1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35_rle_crop_4029144673_0.png resize: (931, 959) 1393693529 0.7175101228416785 treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144677_0.png resize: (518, 313) 1393693530 -0.0024833781731561262 treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144679_0.png resize: (974, 1345) 1393693531 -0.8771709923202673 treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144619_0.png resize: (228, 90) 1393693533 -1.7235721965831026 treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144626_0.png resize: (414, 146) 1393693534 -1.3524909450622369 treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144631_0.png resize: (290, 158) 1393693535 -1.1319034309522666 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 85 time used for this insertion : 0.020411252975463867 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 85 time used for this insertion : 0.01654052734375 save missing photos in datou_result : time spend for datou_step_exec : 19.695684909820557 time spend to save output : 0.04190969467163086 total time spend for step 6 : 19.737594604492188 step7:brightness Mon Nov 10 09:32:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5.jpg treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d.jpg treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0.jpg treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a.jpg treat image : temp/1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48.jpg treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066.jpg treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8.jpg treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3.jpg treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4.jpg treat image : temp/1762763427_1945329_1393692108_73b3224e86e1bc87797bfbd3707285c1.jpg treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8.jpg treat image : temp/1762763427_1945329_1393692054_21a768876706f5a468a8e2589c0b8261.jpg treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702.jpg treat image : temp/1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430.jpg treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4.jpg treat image : temp/1762763427_1945329_1393692045_83f4ecf117cfc67b49575a0bfe53cf7f.jpg treat image : temp/1762763427_1945329_1393691775_257cf46eb98843b9394412301d0f840a.jpg treat image : temp/1762763427_1945329_1393691749_7e88a9e66561dca624e42a2791f0d28c.jpg treat image : temp/1762763427_1945329_1393691741_26573bc0aef2edcdc4678818137a1f84.jpg treat image : temp/1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35.jpg treat image : temp/1762763427_1945329_1393691667_47e0f32454d1d48c88a01d35e2280ea0.jpg treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05.jpg treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144617_0.png treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144618_0.png treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144620_0.png treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144621_0.png treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144622_0.png treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144624_0.png treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144625_0.png treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144627_0.png treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144628_0.png treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144629_0.png treat image : temp/1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48_rle_crop_4029144632_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144634_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144635_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144636_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144638_0.png treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144641_0.png treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144642_0.png treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144643_0.png treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144644_0.png treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144645_0.png treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144648_0.png treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144649_0.png treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144650_0.png treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144651_0.png treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144652_0.png treat image : temp/1762763427_1945329_1393692122_59bf0bf4bac6f5ff46c6e55874d98cb4_rle_crop_4029144653_0.png treat image : temp/1762763427_1945329_1393692108_73b3224e86e1bc87797bfbd3707285c1_rle_crop_4029144654_0.png treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144655_0.png treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144657_0.png treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144660_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144663_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144664_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144665_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144667_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144668_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144669_0.png treat image : temp/1762763427_1945329_1393692045_83f4ecf117cfc67b49575a0bfe53cf7f_rle_crop_4029144671_0.png treat image : temp/1762763427_1945329_1393691741_26573bc0aef2edcdc4678818137a1f84_rle_crop_4029144672_0.png treat image : temp/1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35_rle_crop_4029144674_0.png treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144675_0.png treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144678_0.png treat image : temp/1762763427_1945329_1393692259_94020e3f8065a0a1961c5bb9c5ba900d_rle_crop_4029144623_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144637_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144640_0.png treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144676_0.png treat image : temp/1762763427_1945329_1393692179_950d05395b6326e13ab106a2472dea48_rle_crop_4029144633_0.png treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144630_0.png treat image : temp/1762763427_1945329_1393692176_117f566b44dd621a61ab4d0dfdb82066_rle_crop_4029144639_0.png treat image : temp/1762763427_1945329_1393692172_fe24af8cfc23e5c821505083d377a5b8_rle_crop_4029144646_0.png treat image : temp/1762763427_1945329_1393692128_5cac90e48737825bc677c38fcc759ae3_rle_crop_4029144647_0.png treat image : temp/1762763427_1945329_1393692103_06d0d6f20258e5d93d404b8f0a58e4e8_rle_crop_4029144656_0.png treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144658_0.png treat image : temp/1762763427_1945329_1393692053_2b31bc49995b89dea9bbffd0b3b0b702_rle_crop_4029144659_0.png treat image : temp/1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430_rle_crop_4029144661_0.png treat image : temp/1762763427_1945329_1393692051_4ac2401423f610b91f8cf2c6c75f2430_rle_crop_4029144662_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144666_0.png treat image : temp/1762763427_1945329_1393692049_30734e67444fa2ff6c714eba0cce1af4_rle_crop_4029144670_0.png treat image : temp/1762763427_1945329_1393691702_cf0008cc9097f669ff2281f9de5d1f35_rle_crop_4029144673_0.png treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144677_0.png treat image : temp/1762763427_1945329_1393691465_260f7f032e457dbec160e34695d9fa05_rle_crop_4029144679_0.png treat image : temp/1762763427_1945329_1393692262_2b2209d9a51393db2c063298ab75b2b5_rle_crop_4029144619_0.png treat image : temp/1762763427_1945329_1393692184_5b2d7218324b29d0cbd89a34ed7f11e0_rle_crop_4029144626_0.png treat image : temp/1762763427_1945329_1393692182_d9397289f3a907362cac533b9465724a_rle_crop_4029144631_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 85 time used for this insertion : 0.021002531051635742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 85 time used for this insertion : 0.021367788314819336 save missing photos in datou_result : time spend for datou_step_exec : 5.4843339920043945 time spend to save output : 0.04953932762145996 total time spend for step 7 : 5.5338733196258545 step8:velours_tree Mon Nov 10 09:32:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09200286865234375 time spend to save output : 3.910064697265625e-05 total time spend for step 8 : 0.0920419692993164 step9:send_mail_cod Mon Nov 10 09:32:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28381336_10-11-2025_09_32_21.pdf 28381415 imagette283814151762763541 28381416 change filename to text .change filename to text .change filename to text .change filename to text .imagette283814161762763541 28381417 imagette283814171762763542 28381419 change filename to text .change filename to text .change filename to text .imagette283814191762763542 28381420 imagette283814201762763542 28381421 change filename to text .imagette283814211762763542 28381422 imagette283814221762763542 28381423 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283814231762763542 28381424 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283814241762763543 28381425 imagette283814251762763545 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28381336 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28381415,28381416,28381417,28381418,28381419,28381420,28381421,28381422,28381423,28381424,28381425?tags=flou,carton,pet_fonce,environnement,autre,mal_croppe,metal,pehd,papier,pet_clair,background args[1393692262] : ((1393692262, 1.1660232322191226, 492688767), (1393692262, 0.356534603297243, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692259] : ((1393692259, 1.7205416180595825, 492688767), (1393692259, 0.27921336227862203, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692184] : ((1393692184, -0.2578419401546765, 492688767), (1393692184, 0.5616525449806822, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692182] : ((1393692182, -4.2910074176626, 492609224), (1393692182, 0.45212056559061975, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692179] : ((1393692179, -0.5305392789754215, 492688767), (1393692179, 0.565193437169927, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692176] : ((1393692176, -4.261472783015251, 492609224), (1393692176, 0.5695144740948664, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692172] : ((1393692172, -0.5276135603493374, 492688767), (1393692172, 0.4100973415575777, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692128] : ((1393692128, -4.105839526925994, 492609224), (1393692128, 0.5460156107144004, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692122] : ((1393692122, 0.21540962363511612, 492688767), (1393692122, 0.12554625872148173, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692108] : ((1393692108, -2.0313507574489114, 492609224), (1393692108, 1.1387264376157202, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692103] : ((1393692103, -4.358398247217161, 492609224), (1393692103, 0.5344678571373388, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692054] : ((1393692054, 1.403992483948128, 492688767), (1393692054, 1.0466813876046106, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692053] : ((1393692053, -3.335390098315512, 492609224), (1393692053, 0.41967949192850446, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692051] : ((1393692051, 1.111882358914231, 492688767), (1393692051, 0.3052394130720227, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692049] : ((1393692049, -2.690046392663344, 492609224), (1393692049, 0.3721621095532073, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393692045] : ((1393692045, 0.044886554584438194, 492688767), (1393692045, 1.0233707078750018, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393691775] : ((1393691775, 0.09905766204956526, 492688767), (1393691775, 0.8452697292793003, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393691749] : ((1393691749, 0.3032798263861863, 492688767), (1393691749, 0.6371283477199011, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393691741] : ((1393691741, 0.3921152140527259, 492688767), (1393691741, 0.8875223995078348, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393691702] : ((1393691702, 0.5666891769889495, 492688767), (1393691702, 0.5882907011314282, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393691667] : ((1393691667, 5.744555043915684, 492688767), (1393691667, 0.8421050897380883, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com args[1393691465] : ((1393691465, 0.6401253193291694, 492688767), (1393691465, 0.38762476214845565, 2107752395), '0.10644557554713807') We are sending mail with results at report@fotonower.com refus_total : 0.10644557554713807 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28381336 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28381336_10-11-2025_09_32_21.pdf results_Auto_P28381336_10-11-2025_09_32_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28381336_10-11-2025_09_32_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28381336','results_Auto_P28381336_10-11-2025_09_32_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28381336_10-11-2025_09_32_21.pdf','pdf','','0.55','0.10644557554713807') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28381336

https://www.fotonower.com/image?json=false&list_photos_id=1393692262
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1660232322191226)
https://www.fotonower.com/image?json=false&list_photos_id=1393692259
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.7205416180595825)
https://www.fotonower.com/image?json=false&list_photos_id=1393692184
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692182
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692179
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692176
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692172
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692128
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692122
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692108
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692103
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692054
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.403992483948128)
https://www.fotonower.com/image?json=false&list_photos_id=1393692053
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692051
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.111882358914231)
https://www.fotonower.com/image?json=false&list_photos_id=1393692049
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393692045
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393691775
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393691749
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393691741
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393691702
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393691667
La photo est trop floue, merci de reprendre une photo.(avec le score = 5.744555043915684)
https://www.fotonower.com/image?json=false&list_photos_id=1393691465
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.64%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28381416?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28381419?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28381421?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28381423?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28381424?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28381336_10-11-2025_09_32_21.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28381415,28381416,28381417,28381418,28381419,28381420,28381421,28381422,28381423,28381424,28381425?tags=flou,carton,pet_fonce,environnement,autre,mal_croppe,metal,pehd,papier,pet_clair,background.


L'équipe Fotonower 202 b'' Date: Mon, 10 Nov 2025 08:32:27 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: RBOtXjX1TpS8d7mxVqHVpw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393692262, 1393692259, 1393692184, 1393692182, 1393692179, 1393692176, 1393692172, 1393692128, 1393692122, 1393692108, 1393692103, 1393692054, 1393692053, 1393692051, 1393692049, 1393692045, 1393691775, 1393691749, 1393691741, 1393691702, 1393691667, 1393691465] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692262', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692259', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692184', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692182', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692179', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692176', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692172', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692128', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692122', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692108', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692103', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692054', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692053', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692051', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692049', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692045', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691775', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691749', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691741', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691702', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691667', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691465', None, None, None, None, None, '4025857') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 22 time used for this insertion : 0.016969680786132812 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.607533931732178 time spend to save output : 0.017354965209960938 total time spend for step 9 : 5.624888896942139 step10:split_time_score Mon Nov 10 09:32:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 22),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10112025 28381336 Nombre de photos uploadées : 22 / 23040 (0%) 10112025 28381336 Nombre de photos taguées (types de déchets): 0 / 22 (0%) 10112025 28381336 Nombre de photos taguées (volume) : 0 / 22 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.049041748046875e-05 ?????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010724067687988281 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.27721166610717773 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28381334 order by id desc limit 1 Qualite : 0.10644557554713807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28381336_10-11-2025_09_32_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28381336 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28381336 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10112025': {'nb_upload': 22, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393692262, 1393692259, 1393692184, 1393692182, 1393692179, 1393692176, 1393692172, 1393692128, 1393692122, 1393692108, 1393692103, 1393692054, 1393692053, 1393692051, 1393692049, 1393692045, 1393691775, 1393691749, 1393691741, 1393691702, 1393691667, 1393691465] Looping around the photos to save general results len do output : 1 /28381336Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692262', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692259', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692184', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692182', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692179', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692176', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692172', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692128', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692122', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692108', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692103', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692054', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692053', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692051', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692049', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393692045', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691775', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691749', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691741', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691702', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691667', None, None, None, None, None, '4025857') ('3318', None, None, None, None, None, None, None, '4025857') ('3318', '28381336', '1393691465', None, None, None, None, None, '4025857') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.019806623458862305 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.92704439163208 time spend to save output : 0.020100116729736328 total time spend for step 10 : 1.9471445083618164 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 22 set_done_treatment 73.31user 26.23system 2:04.69elapsed 79%CPU (0avgtext+0avgdata 3031360maxresident)k 570248inputs+46936outputs (1017major+2133876minor)pagefaults 0swaps