python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 868293 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4170144'] with mtr_portfolio_ids : ['29081012'] and first list_photo_ids : [] new path : /proc/868293/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 15 ; length of list_pids : 15 ; length of list_args : 15 time to download the photos : 3.0903444290161133 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Dec 2 09:50:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10111 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-02 09:50:35.224266: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-02 09:50:35.250620: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-02 09:50:35.252306: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd5b0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-02 09:50:35.252328: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-02 09:50:35.255437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-02 09:50:35.508581: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x114d6200 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-02 09:50:35.508647: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-02 09:50:35.510164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-02 09:50:35.510688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 09:50:35.513730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 09:50:35.531024: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-02 09:50:35.531778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-02 09:50:35.539564: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-02 09:50:35.541618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-02 09:50:35.569808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-02 09:50:35.572485: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-02 09:50:35.573008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 09:50:35.574111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-02 09:50:35.574136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-02 09:50:35.574150: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-02 09:50:35.576551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9362 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-02 09:50:35.908456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-02 09:50:35.908589: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 09:50:35.908614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 09:50:35.908635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-02 09:50:35.908656: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-02 09:50:35.908678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-02 09:50:35.908701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-02 09:50:35.908721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-02 09:50:35.910364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-02 09:50:35.911859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-02 09:50:35.911913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-02 09:50:35.911936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 09:50:35.911957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-02 09:50:35.911977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-02 09:50:35.911996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-02 09:50:35.912014: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-02 09:50:35.912034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-02 09:50:35.913656: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-02 09:50:35.913701: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-02 09:50:35.913712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-02 09:50:35.913722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-02 09:50:35.915413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9362 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-02 09:50:50.743307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-02 09:50:50.986501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 868783 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3629 tf kernel not reseted sub process len(results) : 15 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 15 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10111 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1560, 2718, 1986, 2970] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025072097778320312 nb_pixel_total : 65207 time to create 1 rle with old method : 0.07758426666259766 length of segment : 373 DEBUG bbox = [1278, 2136, 1968, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005218982696533203 nb_pixel_total : 226296 time to create 1 rle with new method : 0.014535903930664062 length of segment : 785 DEBUG bbox = [648, 1914, 1050, 2178] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000957489013671875 nb_pixel_total : 68917 time to create 1 rle with old method : 0.08103108406066895 length of segment : 450 DEBUG bbox = [1866, 1260, 2010, 1566] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 35303 time to create 1 rle with old method : 0.04257965087890625 length of segment : 135 DEBUG bbox = [864, 1818, 1656, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.010111570358276367 nb_pixel_total : 279789 time to create 1 rle with new method : 0.04219770431518555 length of segment : 869 DEBUG bbox = [1248, 2202, 1950, 2748] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.006427288055419922 nb_pixel_total : 206643 time to create 1 rle with new method : 0.020316362380981445 length of segment : 640 DEBUG bbox = [36, 3402, 282, 3546] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 24375 time to create 1 rle with old method : 0.02900409698486328 length of segment : 258 DEBUG bbox = [342, 684, 516, 882] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 17105 time to create 1 rle with old method : 0.021479368209838867 length of segment : 156 DEBUG bbox = [1872, 1320, 2148, 1590] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008502006530761719 nb_pixel_total : 48997 time to create 1 rle with old method : 0.05894112586975098 length of segment : 276 DEBUG bbox = [1680, 1800, 2046, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015985965728759766 nb_pixel_total : 53048 time to create 1 rle with old method : 0.0651097297668457 length of segment : 326 DEBUG bbox = [1548, 2544, 1758, 2790] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006575584411621094 nb_pixel_total : 30085 time to create 1 rle with old method : 0.044310808181762695 length of segment : 230 DEBUG bbox = [924, 984, 1422, 1248] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013689994812011719 nb_pixel_total : 54071 time to create 1 rle with old method : 0.07006955146789551 length of segment : 394 DEBUG bbox = [138, 2208, 474, 2682] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016353130340576172 nb_pixel_total : 61360 time to create 1 rle with old method : 0.08776497840881348 length of segment : 301 DEBUG bbox = [1278, 318, 1488, 444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 13962 time to create 1 rle with old method : 0.01725935935974121 length of segment : 195 DEBUG bbox = [1818, 1644, 1980, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005404949188232422 nb_pixel_total : 17727 time to create 1 rle with old method : 0.02158069610595703 length of segment : 149 DEBUG bbox = [342, 2532, 546, 2730] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 23203 time to create 1 rle with old method : 0.027957677841186523 length of segment : 187 DEBUG bbox = [1170, 1986, 1536, 2544] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002232789993286133 nb_pixel_total : 115121 time to create 1 rle with old method : 0.14876317977905273 length of segment : 322 DEBUG bbox = [456, 894, 612, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003027915954589844 nb_pixel_total : 12021 time to create 1 rle with old method : 0.014929771423339844 length of segment : 125 DEBUG bbox = [234, 72, 612, 300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008223056793212891 nb_pixel_total : 40989 time to create 1 rle with old method : 0.04895472526550293 length of segment : 308 DEBUG bbox = [900, 3036, 1242, 3210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006566047668457031 nb_pixel_total : 33992 time to create 1 rle with old method : 0.040859222412109375 length of segment : 284 DEBUG bbox = [1086, 3000, 1488, 3330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001230478286743164 nb_pixel_total : 80421 time to create 1 rle with old method : 0.09448361396789551 length of segment : 390 DEBUG bbox = [822, 1836, 1338, 2394] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003361940383911133 nb_pixel_total : 144191 time to create 1 rle with old method : 0.17094635963439941 length of segment : 442 DEBUG bbox = [762, 744, 876, 984] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005717277526855469 nb_pixel_total : 17007 time to create 1 rle with old method : 0.020757198333740234 length of segment : 130 DEBUG bbox = [1428, 1944, 1686, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006060600280761719 nb_pixel_total : 30487 time to create 1 rle with old method : 0.04027700424194336 length of segment : 252 DEBUG bbox = [12, 2022, 132, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00041794776916503906 nb_pixel_total : 14168 time to create 1 rle with old method : 0.01752448081970215 length of segment : 141 DEBUG bbox = [1710, 2880, 1896, 2994] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 14308 time to create 1 rle with old method : 0.017450571060180664 length of segment : 184 DEBUG bbox = [1182, 1458, 1380, 1626] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004374980926513672 nb_pixel_total : 18822 time to create 1 rle with old method : 0.022573471069335938 length of segment : 167 DEBUG bbox = [534, 1074, 912, 1602] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016772747039794922 nb_pixel_total : 90467 time to create 1 rle with old method : 0.10691118240356445 length of segment : 342 DEBUG bbox = [402, 1680, 540, 1866] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 13863 time to create 1 rle with old method : 0.017707347869873047 length of segment : 119 DEBUG bbox = [966, 2670, 1098, 2784] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 8908 time to create 1 rle with old method : 0.011027097702026367 length of segment : 111 DEBUG bbox = [42, 2502, 240, 2766] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006473064422607422 nb_pixel_total : 36136 time to create 1 rle with old method : 0.05092501640319824 length of segment : 224 DEBUG bbox = [1410, 840, 1674, 1368] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014293193817138672 nb_pixel_total : 67113 time to create 1 rle with old method : 0.08550643920898438 length of segment : 311 DEBUG bbox = [462, 1272, 966, 2088] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004750728607177734 nb_pixel_total : 275600 time to create 1 rle with new method : 0.01596546173095703 length of segment : 590 DEBUG bbox = [228, 1536, 528, 2040] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 78770 time to create 1 rle with old method : 0.10311079025268555 length of segment : 452 DEBUG bbox = [42, 774, 486, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013909339904785156 nb_pixel_total : 78106 time to create 1 rle with old method : 0.09983134269714355 length of segment : 462 DEBUG bbox = [1128, 1428, 1344, 1638] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005121231079101562 nb_pixel_total : 26088 time to create 1 rle with old method : 0.03260183334350586 length of segment : 203 DEBUG bbox = [228, 84, 390, 276] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003857612609863281 nb_pixel_total : 19740 time to create 1 rle with old method : 0.023935317993164062 length of segment : 153 DEBUG bbox = [1356, 792, 1698, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003123760223388672 nb_pixel_total : 96451 time to create 1 rle with old method : 0.1260237693786621 length of segment : 336 DEBUG bbox = [0, 900, 126, 1038] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006010532379150391 nb_pixel_total : 13087 time to create 1 rle with old method : 0.016021728515625 length of segment : 120 DEBUG bbox = [1770, 1560, 2016, 1986] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019845962524414062 nb_pixel_total : 90437 time to create 1 rle with old method : 0.10779094696044922 length of segment : 255 DEBUG bbox = [468, 1740, 1092, 2280] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005763053894042969 nb_pixel_total : 190325 time to create 1 rle with new method : 0.01394200325012207 length of segment : 555 DEBUG bbox = [396, 1764, 1104, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003844738006591797 nb_pixel_total : 196825 time to create 1 rle with new method : 0.014822006225585938 length of segment : 580 DEBUG bbox = [204, 3324, 474, 3564] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013854503631591797 nb_pixel_total : 38222 time to create 1 rle with old method : 0.04502582550048828 length of segment : 228 DEBUG bbox = [1002, 2718, 1206, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009312629699707031 nb_pixel_total : 21430 time to create 1 rle with old method : 0.026138782501220703 length of segment : 197 DEBUG bbox = [780, 996, 954, 1188] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007715225219726562 nb_pixel_total : 21896 time to create 1 rle with old method : 0.02643418312072754 length of segment : 160 DEBUG bbox = [570, 360, 768, 612] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011594295501708984 nb_pixel_total : 17917 time to create 1 rle with old method : 0.02217864990234375 length of segment : 169 DEBUG bbox = [12, 1200, 84, 1314] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 4848 time to create 1 rle with old method : 0.006194591522216797 length of segment : 61 DEBUG bbox = [348, 1176, 510, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005040884017944336 nb_pixel_total : 19781 time to create 1 rle with old method : 0.024442672729492188 length of segment : 148 DEBUG bbox = [276, 12, 564, 156] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011556148529052734 nb_pixel_total : 17073 time to create 1 rle with old method : 0.020640850067138672 length of segment : 261 DEBUG bbox = [330, 1722, 660, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0029129981994628906 nb_pixel_total : 86585 time to create 1 rle with old method : 0.1045835018157959 length of segment : 298 DEBUG bbox = [276, 198, 474, 558] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015492439270019531 nb_pixel_total : 40471 time to create 1 rle with old method : 0.049518585205078125 length of segment : 166 DEBUG bbox = [198, 1446, 354, 1584] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010788440704345703 nb_pixel_total : 13012 time to create 1 rle with old method : 0.021152973175048828 length of segment : 137 DEBUG bbox = [1800, 1848, 2148, 2064] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001834869384765625 nb_pixel_total : 54266 time to create 1 rle with old method : 0.0655517578125 length of segment : 336 DEBUG bbox = [288, 2616, 582, 2928] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001920938491821289 nb_pixel_total : 57582 time to create 1 rle with old method : 0.06826591491699219 length of segment : 287 DEBUG bbox = [1992, 2454, 2160, 2634] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007011890411376953 nb_pixel_total : 16977 time to create 1 rle with old method : 0.0216519832611084 length of segment : 162 DEBUG bbox = [1464, 1680, 1842, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002393960952758789 nb_pixel_total : 53598 time to create 1 rle with old method : 0.06480717658996582 length of segment : 351 DEBUG bbox = [318, 2892, 630, 3090] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015740394592285156 nb_pixel_total : 41186 time to create 1 rle with old method : 0.04922604560852051 length of segment : 466 DEBUG bbox = [942, 2016, 1176, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002562999725341797 nb_pixel_total : 33209 time to create 1 rle with old method : 0.03979206085205078 length of segment : 199 DEBUG bbox = [486, 2196, 672, 2496] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011894702911376953 nb_pixel_total : 33465 time to create 1 rle with old method : 0.04019451141357422 length of segment : 199 DEBUG bbox = [318, 522, 684, 660] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012946128845214844 nb_pixel_total : 25880 time to create 1 rle with old method : 0.030923128128051758 length of segment : 320 DEBUG bbox = [54, 2364, 300, 2502] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007264614105224609 nb_pixel_total : 28201 time to create 1 rle with old method : 0.034142494201660156 length of segment : 236 DEBUG bbox = [42, 462, 276, 642] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 25916 time to create 1 rle with old method : 0.033303260803222656 length of segment : 195 DEBUG bbox = [1806, 1602, 2004, 1944] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008800029754638672 nb_pixel_total : 32274 time to create 1 rle with old method : 0.04033946990966797 length of segment : 183 DEBUG bbox = [438, 552, 714, 672] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006794929504394531 nb_pixel_total : 22457 time to create 1 rle with old method : 0.02746868133544922 length of segment : 264 DEBUG bbox = [618, 486, 816, 612] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 15187 time to create 1 rle with old method : 0.01906895637512207 length of segment : 170 DEBUG bbox = [696, 678, 954, 948] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008649826049804688 nb_pixel_total : 35261 time to create 1 rle with old method : 0.04321169853210449 length of segment : 338 DEBUG bbox = [168, 1422, 384, 1560] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006046295166015625 nb_pixel_total : 16971 time to create 1 rle with old method : 0.02378082275390625 length of segment : 163 DEBUG bbox = [312, 3132, 516, 3282] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006158351898193359 nb_pixel_total : 17441 time to create 1 rle with old method : 0.021158695220947266 length of segment : 186 DEBUG bbox = [534, 3018, 834, 3150] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008614063262939453 nb_pixel_total : 27980 time to create 1 rle with old method : 0.03356027603149414 length of segment : 297 DEBUG bbox = [120, 48, 600, 192] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001962423324584961 nb_pixel_total : 53717 time to create 1 rle with old method : 0.06440067291259766 length of segment : 466 DEBUG bbox = [984, 1170, 1398, 1626] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0033044815063476562 nb_pixel_total : 116941 time to create 1 rle with old method : 0.14426183700561523 length of segment : 400 DEBUG bbox = [714, 1416, 882, 1848] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011413097381591797 nb_pixel_total : 48591 time to create 1 rle with old method : 0.059082746505737305 length of segment : 155 DEBUG bbox = [1614, 2208, 2022, 2490] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018825531005859375 nb_pixel_total : 77008 time to create 1 rle with old method : 0.09368062019348145 length of segment : 380 DEBUG bbox = [24, 2580, 618, 3276] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004904747009277344 nb_pixel_total : 89707 time to create 1 rle with old method : 0.10881400108337402 length of segment : 616 DEBUG bbox = [1854, 2526, 2130, 2868] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017404556274414062 nb_pixel_total : 52727 time to create 1 rle with old method : 0.06521749496459961 length of segment : 262 DEBUG bbox = [1794, 552, 2040, 792] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010826587677001953 nb_pixel_total : 40425 time to create 1 rle with old method : 0.04868745803833008 length of segment : 239 DEBUG bbox = [1392, 2712, 1566, 2874] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 17890 time to create 1 rle with old method : 0.021853208541870117 length of segment : 167 DEBUG bbox = [750, 1902, 1020, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001210927963256836 nb_pixel_total : 39901 time to create 1 rle with old method : 0.04815554618835449 length of segment : 248 DEBUG bbox = [1764, 1860, 2100, 2298] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002365589141845703 nb_pixel_total : 89884 time to create 1 rle with old method : 0.11321449279785156 length of segment : 297 DEBUG bbox = [1548, 1998, 1782, 2262] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009889602661132812 nb_pixel_total : 39005 time to create 1 rle with old method : 0.04628944396972656 length of segment : 273 DEBUG bbox = [126, 2616, 354, 2904] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010051727294921875 nb_pixel_total : 26985 time to create 1 rle with old method : 0.0329585075378418 length of segment : 185 DEBUG bbox = [204, 918, 432, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007786750793457031 nb_pixel_total : 27935 time to create 1 rle with old method : 0.03432869911193848 length of segment : 192 DEBUG bbox = [894, 1380, 1188, 1668] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014340877532958984 nb_pixel_total : 45156 time to create 1 rle with old method : 0.05460953712463379 length of segment : 263 DEBUG bbox = [330, 858, 630, 1002] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 28953 time to create 1 rle with old method : 0.03456687927246094 length of segment : 287 DEBUG bbox = [1596, 1050, 1860, 1194] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009829998016357422 nb_pixel_total : 21643 time to create 1 rle with old method : 0.028850078582763672 length of segment : 241 DEBUG bbox = [1824, 1332, 2148, 1512] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010771751403808594 nb_pixel_total : 24957 time to create 1 rle with old method : 0.029884815216064453 length of segment : 302 DEBUG bbox = [12, 1458, 126, 1692] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005049705505371094 nb_pixel_total : 16131 time to create 1 rle with old method : 0.021348237991333008 length of segment : 106 DEBUG bbox = [1332, 2430, 1584, 2640] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012068748474121094 nb_pixel_total : 34493 time to create 1 rle with old method : 0.056586265563964844 length of segment : 235 time spent for convertir_results : 9.310222387313843 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 88 chid ids of type : 3594 Number RLEs to save : 24773 save missing photos in datou_result : time spend for datou_step_exec : 97.24824452400208 time spend to save output : 2.051851749420166 total time spend for step 1 : 99.30009627342224 step2:crop_condition Tue Dec 2 09:52:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 15 ! batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764665543_868293 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076046_0.png', 0, 263, 375, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076049_0.png', 0, 540, 616, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076055_0.png', 0, 252, 330, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076058_0.png', 0, 180, 149, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076060_0.png', 0, 558, 306, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076066_0.png', 0, 200, 110, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076069_0.png', 0, 113, 184, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076071_0.png', 0, 461, 342, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076074_0.png', 0, 253, 196, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076075_0.png', 0, 469, 226, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076076_0.png', 0, 815, 463, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1_rle_crop_4054076079_0.png', 0, 187, 203, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076081_0.png', 0, 571, 298, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076083_0.png', 0, 426, 234, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076085_0.png', 0, 495, 580, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076094_0.png', 0, 356, 166, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076098_0.png', 0, 179, 162, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076099_0.png', 0, 324, 307, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076100_0.png', 0, 198, 309, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076103_0.png', 0, 126, 320, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877_rle_crop_4054076105_0.png', 0, 173, 192, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076106_0.png', 0, 337, 173, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076109_0.png', 0, 267, 255, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076111_0.png', 0, 134, 186, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076112_0.png', 0, 128, 297, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076123_0.png', 0, 259, 221, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076125_0.png', 0, 200, 192, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076127_0.png', 0, 143, 286, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665549), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076128_0.png', 0, 138, 241, 0, 1764665549,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.057868480682373 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764665557_868293 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076051_0.png', 0, 148, 155, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076053_0.png', 0, 537, 326, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076061_0.png', 0, 153, 123, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076084_0.png', 0, 495, 549, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076089_0.png', 0, 188, 169, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076092_0.png', 0, 112, 261, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076097_0.png', 0, 289, 268, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076102_0.png', 0, 277, 164, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076107_0.png', 0, 116, 264, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076108_0.png', 0, 125, 170, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076115_0.png', 0, 395, 153, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076117_0.png', 0, 577, 502, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076126_0.png', 0, 254, 263, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665560), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076131_0.png', 0, 201, 233, 0, 1764665560,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.219417095184326 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764665565_868293 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076047_0.png', 0, 303, 133, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076054_0.png', 0, 244, 204, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076057_0.png', 0, 96, 194, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076059_0.png', 0, 177, 183, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076063_0.png', 0, 160, 284, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076073_0.png', 0, 107, 107, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1_rle_crop_4054076080_0.png', 0, 184, 151, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076087_0.png', 0, 150, 195, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076088_0.png', 0, 166, 159, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076095_0.png', 0, 125, 137, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665568), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076120_0.png', 0, 135, 167, 0, 1764665568,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.8056259155273438 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764665579_868293 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076044_0.png', 0, 217, 372, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076045_0.png', 0, 543, 641, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076048_0.png', 0, 679, 681, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076050_0.png', 0, 127, 233, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076052_0.png', 0, 244, 274, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076056_0.png', 0, 410, 230, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076062_0.png', 0, 196, 295, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076064_0.png', 0, 302, 348, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076065_0.png', 0, 532, 422, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076068_0.png', 0, 223, 116, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076072_0.png', 0, 165, 119, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076077_0.png', 0, 471, 249, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076078_0.png', 0, 315, 394, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076082_0.png', 0, 138, 119, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076086_0.png', 0, 224, 228, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076090_0.png', 0, 101, 61, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076093_0.png', 0, 373, 287, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076096_0.png', 0, 202, 334, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877_rle_crop_4054076104_0.png', 0, 132, 235, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076110_0.png', 0, 125, 158, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076113_0.png', 0, 136, 466, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076114_0.png', 0, 407, 393, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076118_0.png', 0, 306, 262, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076119_0.png', 0, 226, 239, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076122_0.png', 0, 384, 290, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076124_0.png', 0, 242, 183, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076129_0.png', 0, 144, 302, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665584), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076130_0.png', 0, 211, 106, 0, 1764665584,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.699626922607422 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764665589_868293 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665591), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076067_0.png', 0, 159, 224, 0, 1764665591,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665591), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076070_0.png', 0, 149, 165, 0, 1764665591,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665591), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076091_0.png', 0, 155, 148, 0, 1764665591,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665591), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076101_0.png', 0, 202, 199, 0, 1764665591,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665591), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076116_0.png', 0, 270, 375, 0, 1764665591,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764665591), 0.0, 0.0, 14, '', 0, 0, '1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076121_0.png', 0, 208, 242, 0, 1764665591,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8767311573028564 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1397281457, 1397281456, 1397281455, 1397281452, 1397281449, 1397281441, 1397281439, 1397281438, 1397281436, 1397281433, 1397281430, 1397281424, 1397281423, 1397281416, 1397281413] Looping around the photos to save general results len do output : 88 /1397291583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1397291708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281457', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281456', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281455', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281452', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281449', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281441', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281439', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281438', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281436', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281433', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281430', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281424', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281423', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281416', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281413', None, None, None, None, None, '4170144') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 279 time used for this insertion : 0.06045866012573242 save_final save missing photos in datou_result : time spend for datou_step_exec : 60.45917558670044 time spend to save output : 0.06324982643127441 total time spend for step 2 : 60.522425413131714 step3:rle_unique_nms_with_priority Tue Dec 2 09:53:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 4.707235336303711 time for calcul the mask position with numpy : 1.1864027976989746 nb_pixel_total : 7612920 time to create 1 rle with new method : 1.2547824382781982 time for calcul the mask position with numpy : 0.027189254760742188 nb_pixel_total : 5968 time to create 1 rle with old method : 0.00763392448425293 time for calcul the mask position with numpy : 0.044142723083496094 nb_pixel_total : 279789 time to create 1 rle with new method : 0.9188408851623535 time for calcul the mask position with numpy : 0.041246652603149414 nb_pixel_total : 35303 time to create 1 rle with old method : 0.042532920837402344 time for calcul the mask position with numpy : 0.040253639221191406 nb_pixel_total : 68917 time to create 1 rle with old method : 0.08102297782897949 time for calcul the mask position with numpy : 0.04069852828979492 nb_pixel_total : 226296 time to create 1 rle with new method : 0.5990321636199951 time for calcul the mask position with numpy : 0.026755809783935547 nb_pixel_total : 65207 time to create 1 rle with old method : 0.07785868644714355 create new chi : 4.496968984603882 time to delete rle : 0.028484344482421875 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 8103 TO DO : save crop sub photo not yet done ! save time : 0.5751605033874512 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 7.596780300140381 time for calcul the mask position with numpy : 0.8104209899902344 nb_pixel_total : 7835352 time to create 1 rle with new method : 1.034970760345459 time for calcul the mask position with numpy : 0.027530193328857422 nb_pixel_total : 115121 time to create 1 rle with old method : 0.1341569423675537 time for calcul the mask position with numpy : 0.025765657424926758 nb_pixel_total : 23197 time to create 1 rle with old method : 0.03196120262145996 time for calcul the mask position with numpy : 0.026107311248779297 nb_pixel_total : 17727 time to create 1 rle with old method : 0.021062850952148438 time for calcul the mask position with numpy : 0.0258791446685791 nb_pixel_total : 13962 time to create 1 rle with old method : 0.01650524139404297 time for calcul the mask position with numpy : 0.028004169464111328 nb_pixel_total : 61360 time to create 1 rle with old method : 0.07614898681640625 time for calcul the mask position with numpy : 0.027312040328979492 nb_pixel_total : 54071 time to create 1 rle with old method : 0.0732421875 time for calcul the mask position with numpy : 0.028646230697631836 nb_pixel_total : 30085 time to create 1 rle with old method : 0.042339324951171875 time for calcul the mask position with numpy : 0.034084320068359375 nb_pixel_total : 53048 time to create 1 rle with old method : 0.06238579750061035 time for calcul the mask position with numpy : 0.039408206939697266 nb_pixel_total : 48997 time to create 1 rle with old method : 0.05731916427612305 time for calcul the mask position with numpy : 0.03947710990905762 nb_pixel_total : 17105 time to create 1 rle with old method : 0.0203096866607666 time for calcul the mask position with numpy : 0.04314565658569336 nb_pixel_total : 24375 time to create 1 rle with old method : 0.030935049057006836 create new chi : 2.806405544281006 time to delete rle : 0.0011870861053466797 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 7740 TO DO : save crop sub photo not yet done ! save time : 0.5742044448852539 nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 7.2134177684783936 time for calcul the mask position with numpy : 0.6744668483734131 nb_pixel_total : 7887994 time to create 1 rle with new method : 0.9592163562774658 time for calcul the mask position with numpy : 0.0438077449798584 nb_pixel_total : 18822 time to create 1 rle with old method : 0.0224759578704834 time for calcul the mask position with numpy : 0.03744649887084961 nb_pixel_total : 14308 time to create 1 rle with old method : 0.016995906829833984 time for calcul the mask position with numpy : 0.02960038185119629 nb_pixel_total : 14168 time to create 1 rle with old method : 0.01682138442993164 time for calcul the mask position with numpy : 0.03299212455749512 nb_pixel_total : 30487 time to create 1 rle with old method : 0.036386728286743164 time for calcul the mask position with numpy : 0.03324437141418457 nb_pixel_total : 17007 time to create 1 rle with old method : 0.02013564109802246 time for calcul the mask position with numpy : 0.027840375900268555 nb_pixel_total : 144191 time to create 1 rle with old method : 0.1784050464630127 time for calcul the mask position with numpy : 0.02591729164123535 nb_pixel_total : 80421 time to create 1 rle with old method : 0.10030245780944824 time for calcul the mask position with numpy : 0.02764296531677246 nb_pixel_total : 33992 time to create 1 rle with old method : 0.0405275821685791 time for calcul the mask position with numpy : 0.03244519233703613 nb_pixel_total : 40989 time to create 1 rle with old method : 0.048484086990356445 time for calcul the mask position with numpy : 0.043593645095825195 nb_pixel_total : 12021 time to create 1 rle with old method : 0.014415740966796875 create new chi : 2.5129828453063965 time to delete rle : 0.0014078617095947266 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7006 TO DO : save crop sub photo not yet done ! save time : 0.5412797927856445 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.984372854232788 time for calcul the mask position with numpy : 0.9692792892456055 nb_pixel_total : 8145026 time to create 1 rle with new method : 1.0346484184265137 time for calcul the mask position with numpy : 0.04166817665100098 nb_pixel_total : 36136 time to create 1 rle with old method : 0.04280972480773926 time for calcul the mask position with numpy : 0.02573394775390625 nb_pixel_total : 8908 time to create 1 rle with old method : 0.01121068000793457 time for calcul the mask position with numpy : 0.02752208709716797 nb_pixel_total : 13863 time to create 1 rle with old method : 0.016446352005004883 time for calcul the mask position with numpy : 0.02688908576965332 nb_pixel_total : 90467 time to create 1 rle with old method : 0.13001799583435059 create new chi : 2.3792777061462402 time to delete rle : 0.0010395050048828125 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 3752 TO DO : save crop sub photo not yet done ! save time : 0.3216118812561035 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 3.8300564289093018 time for calcul the mask position with numpy : 1.3910331726074219 nb_pixel_total : 7794811 time to create 1 rle with new method : 1.3588147163391113 time for calcul the mask position with numpy : 0.04107069969177246 nb_pixel_total : 78106 time to create 1 rle with old method : 0.09064054489135742 time for calcul the mask position with numpy : 0.040152549743652344 nb_pixel_total : 78770 time to create 1 rle with old method : 0.08987569808959961 time for calcul the mask position with numpy : 0.04049825668334961 nb_pixel_total : 275600 time to create 1 rle with new method : 1.0400288105010986 time for calcul the mask position with numpy : 0.028954744338989258 nb_pixel_total : 67113 time to create 1 rle with old method : 0.07667303085327148 create new chi : 4.276573419570923 time to delete rle : 0.0009553432464599609 batch 1 Loaded 9 chid ids of type : 3594 +++++++++Number RLEs to save : 5790 TO DO : save crop sub photo not yet done ! save time : 0.4166550636291504 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.616513729095459 time for calcul the mask position with numpy : 0.6555683612823486 nb_pixel_total : 8248572 time to create 1 rle with new method : 0.940161943435669 time for calcul the mask position with numpy : 0.025200366973876953 nb_pixel_total : 19740 time to create 1 rle with old method : 0.02293229103088379 time for calcul the mask position with numpy : 0.02427053451538086 nb_pixel_total : 26088 time to create 1 rle with old method : 0.032418251037597656 create new chi : 1.7443804740905762 time to delete rle : 0.0012803077697753906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2872 TO DO : save crop sub photo not yet done ! save time : 0.26721835136413574 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 6.131769180297852 time for calcul the mask position with numpy : 0.3477773666381836 nb_pixel_total : 7837309 time to create 1 rle with new method : 0.9819574356079102 time for calcul the mask position with numpy : 0.025768518447875977 nb_pixel_total : 21430 time to create 1 rle with old method : 0.025382041931152344 time for calcul the mask position with numpy : 0.028373003005981445 nb_pixel_total : 38222 time to create 1 rle with old method : 0.04498457908630371 time for calcul the mask position with numpy : 0.030879974365234375 nb_pixel_total : 7139 time to create 1 rle with old method : 0.00908517837524414 time for calcul the mask position with numpy : 0.029796600341796875 nb_pixel_total : 190325 time to create 1 rle with new method : 1.2337303161621094 time for calcul the mask position with numpy : 0.026531457901000977 nb_pixel_total : 90437 time to create 1 rle with old method : 0.1192173957824707 time for calcul the mask position with numpy : 0.028746366500854492 nb_pixel_total : 13087 time to create 1 rle with old method : 0.015505075454711914 time for calcul the mask position with numpy : 0.026590824127197266 nb_pixel_total : 96451 time to create 1 rle with old method : 0.11343526840209961 create new chi : 3.165677309036255 time to delete rle : 0.0011057853698730469 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6338 TO DO : save crop sub photo not yet done ! save time : 0.4662649631500244 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 4.788534879684448 time for calcul the mask position with numpy : 1.1863389015197754 nb_pixel_total : 8229958 time to create 1 rle with new method : 1.1501073837280273 time for calcul the mask position with numpy : 0.04273629188537598 nb_pixel_total : 19781 time to create 1 rle with old method : 0.023130178451538086 time for calcul the mask position with numpy : 0.03721332550048828 nb_pixel_total : 4848 time to create 1 rle with old method : 0.005745887756347656 time for calcul the mask position with numpy : 0.026711225509643555 nb_pixel_total : 17917 time to create 1 rle with old method : 0.021886825561523438 time for calcul the mask position with numpy : 0.03270912170410156 nb_pixel_total : 21896 time to create 1 rle with old method : 0.026505708694458008 create new chi : 2.60900616645813 time to delete rle : 0.000850677490234375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3236 TO DO : save crop sub photo not yet done ! save time : 0.26972365379333496 nb_obj : 12 nb_hashtags : 5 time to prepare the origin masks : 9.91797423362732 time for calcul the mask position with numpy : 0.5325086116790771 nb_pixel_total : 7821096 time to create 1 rle with new method : 1.2425036430358887 time for calcul the mask position with numpy : 0.026465177536010742 nb_pixel_total : 25880 time to create 1 rle with old method : 0.03351092338562012 time for calcul the mask position with numpy : 0.027998924255371094 nb_pixel_total : 33465 time to create 1 rle with old method : 0.04161477088928223 time for calcul the mask position with numpy : 0.03351402282714844 nb_pixel_total : 33209 time to create 1 rle with old method : 0.04642319679260254 time for calcul the mask position with numpy : 0.0362544059753418 nb_pixel_total : 41186 time to create 1 rle with old method : 0.0591123104095459 time for calcul the mask position with numpy : 0.034918785095214844 nb_pixel_total : 53598 time to create 1 rle with old method : 0.0658271312713623 time for calcul the mask position with numpy : 0.02909088134765625 nb_pixel_total : 16977 time to create 1 rle with old method : 0.01963353157043457 time for calcul the mask position with numpy : 0.029653549194335938 nb_pixel_total : 57582 time to create 1 rle with old method : 0.06671810150146484 time for calcul the mask position with numpy : 0.027728557586669922 nb_pixel_total : 54266 time to create 1 rle with old method : 0.06418395042419434 time for calcul the mask position with numpy : 0.0245363712310791 nb_pixel_total : 13012 time to create 1 rle with old method : 0.015065193176269531 time for calcul the mask position with numpy : 0.030562162399291992 nb_pixel_total : 40471 time to create 1 rle with old method : 0.046891212463378906 time for calcul the mask position with numpy : 0.04182696342468262 nb_pixel_total : 86585 time to create 1 rle with old method : 0.10052013397216797 time for calcul the mask position with numpy : 0.026262521743774414 nb_pixel_total : 17073 time to create 1 rle with old method : 0.02017951011657715 create new chi : 2.7761592864990234 time to delete rle : 0.0014531612396240234 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8522 TO DO : save crop sub photo not yet done ! save time : 0.6393108367919922 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 3.702672004699707 time for calcul the mask position with numpy : 1.2794873714447021 nb_pixel_total : 8240283 time to create 1 rle with new method : 1.5104918479919434 time for calcul the mask position with numpy : 0.02609848976135254 nb_pixel_total : 25916 time to create 1 rle with old method : 0.030286312103271484 time for calcul the mask position with numpy : 0.026428937911987305 nb_pixel_total : 28201 time to create 1 rle with old method : 0.042960405349731445 create new chi : 2.964989423751831 time to delete rle : 0.0005047321319580078 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3022 TO DO : save crop sub photo not yet done ! save time : 0.2512185573577881 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 6.216527700424194 time for calcul the mask position with numpy : 0.9727628231048584 nb_pixel_total : 8172250 time to create 1 rle with new method : 1.24442458152771 time for calcul the mask position with numpy : 0.026402950286865234 nb_pixel_total : 16971 time to create 1 rle with old method : 0.021799802780151367 time for calcul the mask position with numpy : 0.026057720184326172 nb_pixel_total : 35261 time to create 1 rle with old method : 0.04082846641540527 time for calcul the mask position with numpy : 0.025753498077392578 nb_pixel_total : 15187 time to create 1 rle with old method : 0.018021583557128906 time for calcul the mask position with numpy : 0.0262601375579834 nb_pixel_total : 22457 time to create 1 rle with old method : 0.026746749877929688 time for calcul the mask position with numpy : 0.027202129364013672 nb_pixel_total : 32274 time to create 1 rle with old method : 0.03777337074279785 create new chi : 2.545997381210327 time to delete rle : 0.0008027553558349609 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 4396 TO DO : save crop sub photo not yet done ! save time : 0.3281066417694092 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 6.818678855895996 time for calcul the mask position with numpy : 1.3267157077789307 nb_pixel_total : 7863015 time to create 1 rle with new method : 1.2370080947875977 time for calcul the mask position with numpy : 0.04058122634887695 nb_pixel_total : 89707 time to create 1 rle with old method : 0.11361289024353027 time for calcul the mask position with numpy : 0.04663872718811035 nb_pixel_total : 77008 time to create 1 rle with old method : 0.08876562118530273 time for calcul the mask position with numpy : 0.04662203788757324 nb_pixel_total : 48591 time to create 1 rle with old method : 0.056088924407958984 time for calcul the mask position with numpy : 0.04482388496398926 nb_pixel_total : 116941 time to create 1 rle with old method : 0.13488531112670898 time for calcul the mask position with numpy : 0.039259910583496094 nb_pixel_total : 53717 time to create 1 rle with old method : 0.06322097778320312 time for calcul the mask position with numpy : 0.026593685150146484 nb_pixel_total : 27980 time to create 1 rle with old method : 0.033100128173828125 time for calcul the mask position with numpy : 0.026998519897460938 nb_pixel_total : 17441 time to create 1 rle with old method : 0.02082991600036621 create new chi : 3.3963570594787598 time to delete rle : 0.0012927055358886719 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 7160 TO DO : save crop sub photo not yet done ! save time : 0.510317325592041 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 4.3456714153289795 time for calcul the mask position with numpy : 0.674731969833374 nb_pixel_total : 8143457 time to create 1 rle with new method : 1.032846212387085 time for calcul the mask position with numpy : 0.041820526123046875 nb_pixel_total : 39901 time to create 1 rle with old method : 0.04687070846557617 time for calcul the mask position with numpy : 0.04320359230041504 nb_pixel_total : 17890 time to create 1 rle with old method : 0.02225518226623535 time for calcul the mask position with numpy : 0.033715248107910156 nb_pixel_total : 40425 time to create 1 rle with old method : 0.0471806526184082 time for calcul the mask position with numpy : 0.02620100975036621 nb_pixel_total : 52727 time to create 1 rle with old method : 0.061098337173461914 create new chi : 2.0768685340881348 time to delete rle : 0.0007565021514892578 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3992 TO DO : save crop sub photo not yet done ! save time : 0.3134329319000244 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 3.94537091255188 time for calcul the mask position with numpy : 1.592888355255127 nb_pixel_total : 8110591 time to create 1 rle with new method : 1.8929498195648193 time for calcul the mask position with numpy : 0.0421442985534668 nb_pixel_total : 27935 time to create 1 rle with old method : 0.032256364822387695 time for calcul the mask position with numpy : 0.03471255302429199 nb_pixel_total : 26985 time to create 1 rle with old method : 0.03069591522216797 time for calcul the mask position with numpy : 0.0249941349029541 nb_pixel_total : 39005 time to create 1 rle with old method : 0.044765472412109375 time for calcul the mask position with numpy : 0.029727458953857422 nb_pixel_total : 89884 time to create 1 rle with old method : 0.10495972633361816 create new chi : 3.8808460235595703 time to delete rle : 0.0008172988891601562 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 4054 TO DO : save crop sub photo not yet done ! save time : 0.32401323318481445 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 7.973664999008179 time for calcul the mask position with numpy : 1.4257700443267822 nb_pixel_total : 8123067 time to create 1 rle with new method : 0.8986599445343018 time for calcul the mask position with numpy : 0.04606509208679199 nb_pixel_total : 34493 time to create 1 rle with old method : 0.04095053672790527 time for calcul the mask position with numpy : 0.04282546043395996 nb_pixel_total : 16131 time to create 1 rle with old method : 0.019212961196899414 time for calcul the mask position with numpy : 0.039356231689453125 nb_pixel_total : 24957 time to create 1 rle with old method : 0.029529333114624023 time for calcul the mask position with numpy : 0.029321908950805664 nb_pixel_total : 21643 time to create 1 rle with old method : 0.02582383155822754 time for calcul the mask position with numpy : 0.02807331085205078 nb_pixel_total : 28953 time to create 1 rle with old method : 0.03458046913146973 time for calcul the mask position with numpy : 0.02912616729736328 nb_pixel_total : 45156 time to create 1 rle with old method : 0.05750727653503418 create new chi : 2.805011510848999 time to delete rle : 0.0011334419250488281 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5028 TO DO : save crop sub photo not yet done ! save time : 0.40121936798095703 map_output_result : {1397281457: (0.0, 'Should be the crop_list due to order', 0), 1397281456: (0.0, 'Should be the crop_list due to order', 0), 1397281455: (0.0, 'Should be the crop_list due to order', 0), 1397281452: (0.0, 'Should be the crop_list due to order', 0), 1397281449: (0.0, 'Should be the crop_list due to order', 0), 1397281441: (0.0, 'Should be the crop_list due to order', 0), 1397281439: (0.0, 'Should be the crop_list due to order', 0), 1397281438: (0.0, 'Should be the crop_list due to order', 0), 1397281436: (0.0, 'Should be the crop_list due to order', 0), 1397281433: (0.0, 'Should be the crop_list due to order', 0), 1397281430: (0.0, 'Should be the crop_list due to order', 0), 1397281424: (0.0, 'Should be the crop_list due to order', 0), 1397281423: (0.0, 'Should be the crop_list due to order', 0), 1397281416: (0.0, 'Should be the crop_list due to order', 0), 1397281413: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1397281457, 1397281456, 1397281455, 1397281452, 1397281449, 1397281441, 1397281439, 1397281438, 1397281436, 1397281433, 1397281430, 1397281424, 1397281423, 1397281416, 1397281413] Looping around the photos to save general results len do output : 15 /1397281457.Didn't retrieve data . /1397281456.Didn't retrieve data . /1397281455.Didn't retrieve data . /1397281452.Didn't retrieve data . /1397281449.Didn't retrieve data . /1397281441.Didn't retrieve data . /1397281439.Didn't retrieve data . /1397281438.Didn't retrieve data . /1397281436.Didn't retrieve data . /1397281433.Didn't retrieve data . /1397281430.Didn't retrieve data . /1397281424.Didn't retrieve data . /1397281423.Didn't retrieve data . /1397281416.Didn't retrieve data . /1397281413.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281457', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281456', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281455', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281452', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281449', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281441', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281439', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281438', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281436', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281433', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281430', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281424', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281423', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281416', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281413', None, None, None, None, None, '4170144') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.01723957061767578 save_final save missing photos in datou_result : time spend for datou_step_exec : 134.6691918373108 time spend to save output : 0.0247647762298584 total time spend for step 3 : 134.69395661354065 step4:ventilate_hashtags_in_portfolio Tue Dec 2 09:55:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29081012 get user id for portfolio 29081012 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081012 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','carton','pehd','pet_fonce','papier','autre','background','pet_clair','flou','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081012 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','carton','pehd','pet_fonce','papier','autre','background','pet_clair','flou','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081012 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','carton','pehd','pet_fonce','papier','autre','background','pet_clair','flou','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29081488,29081489,29081490,29081491,29081492,29081493,29081494,29081495,29081496,29081497,29081498?tags=environnement,mal_croppe,carton,pehd,pet_fonce,papier,autre,background,pet_clair,flou,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1397281457, 1397281456, 1397281455, 1397281452, 1397281449, 1397281441, 1397281439, 1397281438, 1397281436, 1397281433, 1397281430, 1397281424, 1397281423, 1397281416, 1397281413] Looping around the photos to save general results len do output : 1 /29081012. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281457', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281456', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281455', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281452', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281449', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281441', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281439', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281438', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281436', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281433', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281430', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281424', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281423', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281416', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281413', None, None, None, None, None, '4170144') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.017256498336791992 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3110568523406982 time spend to save output : 0.017701148986816406 total time spend for step 4 : 2.3287580013275146 step5:final Tue Dec 2 09:55:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1397281457: ('0.03496575199331276',), 1397281456: ('0.03496575199331276',), 1397281455: ('0.03496575199331276',), 1397281452: ('0.03496575199331276',), 1397281449: ('0.03496575199331276',), 1397281441: ('0.03496575199331276',), 1397281439: ('0.03496575199331276',), 1397281438: ('0.03496575199331276',), 1397281436: ('0.03496575199331276',), 1397281433: ('0.03496575199331276',), 1397281430: ('0.03496575199331276',), 1397281424: ('0.03496575199331276',), 1397281423: ('0.03496575199331276',), 1397281416: ('0.03496575199331276',), 1397281413: ('0.03496575199331276',)} new output for save of step final : {1397281457: ('0.03496575199331276',), 1397281456: ('0.03496575199331276',), 1397281455: ('0.03496575199331276',), 1397281452: ('0.03496575199331276',), 1397281449: ('0.03496575199331276',), 1397281441: ('0.03496575199331276',), 1397281439: ('0.03496575199331276',), 1397281438: ('0.03496575199331276',), 1397281436: ('0.03496575199331276',), 1397281433: ('0.03496575199331276',), 1397281430: ('0.03496575199331276',), 1397281424: ('0.03496575199331276',), 1397281423: ('0.03496575199331276',), 1397281416: ('0.03496575199331276',), 1397281413: ('0.03496575199331276',)} [1397281457, 1397281456, 1397281455, 1397281452, 1397281449, 1397281441, 1397281439, 1397281438, 1397281436, 1397281433, 1397281430, 1397281424, 1397281423, 1397281416, 1397281413] Looping around the photos to save general results len do output : 15 /1397281457.Didn't retrieve data . /1397281456.Didn't retrieve data . /1397281455.Didn't retrieve data . /1397281452.Didn't retrieve data . /1397281449.Didn't retrieve data . /1397281441.Didn't retrieve data . /1397281439.Didn't retrieve data . /1397281438.Didn't retrieve data . /1397281436.Didn't retrieve data . /1397281433.Didn't retrieve data . /1397281430.Didn't retrieve data . /1397281424.Didn't retrieve data . /1397281423.Didn't retrieve data . /1397281416.Didn't retrieve data . /1397281413.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281457', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281456', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281455', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281452', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281449', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281441', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281439', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281438', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281436', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281433', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281430', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281424', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281423', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281416', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281413', None, None, None, None, None, '4170144') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 45 time used for this insertion : 0.01692509651184082 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.20416951179504395 time spend to save output : 0.01760101318359375 total time spend for step 5 : 0.2217705249786377 step6:blur_detection Tue Dec 2 09:55:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0.jpg resize: (2160, 3840) 1397281457 -6.375111336417485 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1.jpg resize: (2160, 3840) 1397281456 -6.815602478391867 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25.jpg resize: (2160, 3840) 1397281455 -6.980560335588365 treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41.jpg resize: (2160, 3840) 1397281452 -6.907836202349337 treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8.jpg resize: (2160, 3840) 1397281449 -6.840877755063205 treat image : temp/1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1.jpg resize: (2160, 3840) 1397281441 -6.891220430170846 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9.jpg resize: (2160, 3840) 1397281439 -6.998751616040508 treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7.jpg resize: (2160, 3840) 1397281438 -7.240941441256631 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507.jpg resize: (2160, 3840) 1397281436 -6.936043942470375 treat image : temp/1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877.jpg resize: (2160, 3840) 1397281433 -6.927784257505085 treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29.jpg resize: (2160, 3840) 1397281430 -7.046207207632433 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48.jpg resize: (2160, 3840) 1397281424 -7.027529594473723 treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e.jpg resize: (2160, 3840) 1397281423 -6.349068101597018 treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542.jpg resize: (2160, 3840) 1397281416 -6.63066380770523 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26.jpg resize: (2160, 3840) 1397281413 -6.2047274140152515 treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076046_0.png resize: (375, 263) 1397291583 -5.148140083315078 treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076049_0.png resize: (616, 540) 1397291584 -4.966320510180126 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076055_0.png resize: (330, 252) 1397291585 -5.402964528283165 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076058_0.png resize: (149, 180) 1397291586 -3.921329779976883 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076060_0.png resize: (306, 558) 1397291587 -5.108374461451327 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076066_0.png resize: (110, 200) 1397291588 -4.475142606321066 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076069_0.png resize: (184, 113) 1397291589 -3.7741428682980374 treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076071_0.png resize: (342, 461) 1397291590 -3.9749043177783654 treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076074_0.png resize: (196, 253) 1397291591 -4.7598131531634635 treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076075_0.png resize: (226, 469) 1397291592 -5.25206434455987 treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076076_0.png resize: (463, 815) 1397291594 -4.806269061594872 treat image : temp/1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1_rle_crop_4054076079_0.png resize: (203, 187) 1397291595 -4.657616809715189 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076081_0.png resize: (298, 571) 1397291596 -4.328459487646612 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076083_0.png resize: (234, 426) 1397291597 -5.206532304677237 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076085_0.png resize: (580, 495) 1397291598 -4.320680896289583 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076094_0.png resize: (166, 356) 1397291599 -4.740527439563675 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076098_0.png resize: (162, 179) 1397291600 -3.9439635798530746 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076099_0.png resize: (307, 324) 1397291601 -4.392922553778648 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076100_0.png resize: (309, 198) 1397291602 -4.84823272663412 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076103_0.png resize: (320, 126) 1397291603 -4.490932112455312 treat image : temp/1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877_rle_crop_4054076105_0.png resize: (192, 173) 1397291604 -4.903862200722561 treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076106_0.png resize: (173, 337) 1397291605 -4.485557614270622 treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076109_0.png resize: (255, 267) 1397291606 -3.761701416272444 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076111_0.png resize: (186, 134) 1397291607 -4.190214984986164 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076112_0.png resize: (297, 128) 1397291608 -4.802173270961015 treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076123_0.png resize: (221, 259) 1397291609 -4.45811976469709 treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076125_0.png resize: (192, 200) 1397291610 -4.489592419413214 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076127_0.png resize: (286, 143) 1397291611 -4.3157406386532235 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076128_0.png resize: (241, 138) 1397291612 -4.69795853948211 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076051_0.png resize: (155, 148) 1397291618 -3.029491847715595 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076053_0.png resize: (326, 537) 1397291619 -3.094491670191354 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076061_0.png resize: (123, 153) 1397291620 -2.4198336162998846 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076084_0.png resize: (549, 495) 1397291621 -4.2838133279415445 treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076089_0.png resize: (169, 188) 1397291622 -2.6612227414759824 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076092_0.png resize: (261, 112) 1397291623 -5.191958173665769 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076097_0.png resize: (268, 289) 1397291624 -4.497521164326233 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076102_0.png resize: (164, 277) 1397291625 -4.069362296944232 treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076107_0.png resize: (264, 116) 1397291626 -4.075220856770481 treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076108_0.png resize: (170, 125) 1397291627 -2.7934234351434037 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076115_0.png resize: (153, 395) 1397291628 -4.638729496029991 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076117_0.png resize: (502, 577) 1397291629 -3.65068396340267 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076126_0.png resize: (263, 254) 1397291630 -4.178211704031527 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076131_0.png resize: (233, 201) 1397291631 -4.976715905168177 treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076047_0.png resize: (133, 303) 1397291654 -5.296258425303771 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076054_0.png resize: (204, 244) 1397291655 -4.928242949521873 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076057_0.png resize: (194, 96) 1397291656 -4.757160075898128 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076059_0.png resize: (183, 177) 1397291657 -4.295925070279851 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076063_0.png resize: (284, 160) 1397291658 -5.465288528555651 treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076073_0.png resize: (107, 107) 1397291659 -4.864927811865437 treat image : temp/1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1_rle_crop_4054076080_0.png resize: (151, 184) 1397291660 -4.8950434727119125 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076087_0.png resize: (195, 150) 1397291661 -4.955527377039455 treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076088_0.png resize: (159, 166) 1397291663 -3.8674081387952133 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076095_0.png resize: (137, 125) 1397291664 -4.990766130755769 treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076120_0.png resize: (167, 135) 1397291665 -4.313839607087737 treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076044_0.png resize: (372, 217) 1397291674 -4.672626752943144 treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076045_0.png resize: (641, 543) 1397291675 -5.142870413776619 treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076048_0.png resize: (681, 679) 1397291676 -6.08422565949567 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076050_0.png resize: (233, 127) 1397291677 -4.648643045061668 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076052_0.png resize: (274, 244) 1397291678 -5.178299416468204 treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076056_0.png resize: (230, 410) 1397291679 -4.82915752499632 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076062_0.png resize: (295, 196) 1397291680 -5.501947205228138 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076064_0.png resize: (348, 302) 1397291681 -4.910963916904078 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076065_0.png resize: (422, 532) 1397291682 -5.95211744497214 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076068_0.png resize: (116, 223) 1397291683 -4.073606291875594 treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076072_0.png resize: (119, 165) 1397291684 -4.531279497890782 treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076077_0.png resize: (249, 471) 1397291685 -4.750372764203394 treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076078_0.png resize: (394, 315) 1397291686 -4.321204156187533 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076082_0.png resize: (119, 138) 1397291687 -3.1888474729716187 treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076086_0.png resize: (228, 224) 1397291688 -4.153377012008099 treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076090_0.png resize: (61, 101) 1397291689 -3.2603734604525645 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076093_0.png resize: (287, 373) 1397291690 -4.893844660430554 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076096_0.png resize: (334, 202) 1397291691 -5.082194771768405 treat image : temp/1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877_rle_crop_4054076104_0.png resize: (235, 132) 1397291692 -4.238970923336746 treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076110_0.png resize: (158, 125) 1397291693 -2.5553951979939415 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076113_0.png resize: (466, 136) 1397291694 -5.195188512832911 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076114_0.png resize: (393, 407) 1397291695 -4.603007499973209 treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076118_0.png resize: (262, 306) 1397291696 -4.13440878495321 treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076119_0.png resize: (239, 226) 1397291697 -5.300821303399525 treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076122_0.png resize: (290, 384) 1397291698 -4.863084781589817 treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076124_0.png resize: (183, 242) 1397291699 -4.416318729052885 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076129_0.png resize: (302, 144) 1397291700 -4.685351883461731 treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076130_0.png resize: (106, 211) 1397291701 -5.016161755120403 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076067_0.png resize: (224, 159) 1397291703 -4.514325598702105 treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076070_0.png resize: (165, 149) 1397291704 -3.482531987939743 treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076091_0.png resize: (148, 155) 1397291705 -4.459038188960775 treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076101_0.png resize: (199, 202) 1397291706 -3.5171291152581454 treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076116_0.png resize: (375, 270) 1397291707 -4.2120863034107 treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076121_0.png resize: (242, 208) 1397291708 -4.753520982549108 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.02184748649597168 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.04004335403442383 save missing photos in datou_result : time spend for datou_step_exec : 72.19931268692017 time spend to save output : 0.06948733329772949 total time spend for step 6 : 72.2688000202179 step7:brightness Tue Dec 2 09:56:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0.jpg treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1.jpg treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25.jpg treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41.jpg treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8.jpg treat image : temp/1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1.jpg treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9.jpg treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7.jpg treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507.jpg treat image : temp/1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877.jpg treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29.jpg treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48.jpg treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e.jpg treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542.jpg treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26.jpg treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076046_0.png treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076049_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076055_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076058_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076060_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076066_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076069_0.png treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076071_0.png treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076074_0.png treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076075_0.png treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076076_0.png treat image : temp/1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1_rle_crop_4054076079_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076081_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076083_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076085_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076094_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076098_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076099_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076100_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076103_0.png treat image : temp/1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877_rle_crop_4054076105_0.png treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076106_0.png treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076109_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076111_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076112_0.png treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076123_0.png treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076125_0.png treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076127_0.png treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076128_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076051_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076053_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076061_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076084_0.png treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076089_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076092_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076097_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076102_0.png treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076107_0.png treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076108_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076115_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076117_0.png treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076126_0.png treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076131_0.png treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076047_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076054_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076057_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076059_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076063_0.png treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076073_0.png treat image : temp/1764665428_868293_1397281441_24bf4fc65b3a2ea5849907ade17694f1_rle_crop_4054076080_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076087_0.png treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076088_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076095_0.png treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076120_0.png treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076044_0.png treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076045_0.png treat image : temp/1764665428_868293_1397281457_eced929c49c66144cae39df984e78cb0_rle_crop_4054076048_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076050_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076052_0.png treat image : temp/1764665428_868293_1397281456_e6bdb567fb191b1911130148598e6ec1_rle_crop_4054076056_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076062_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076064_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076065_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076068_0.png treat image : temp/1764665428_868293_1397281452_387e3885096eebe62985efcd24a2ed41_rle_crop_4054076072_0.png treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076077_0.png treat image : temp/1764665428_868293_1397281449_6fbf76ed1d18de1425e8d2d254c116e8_rle_crop_4054076078_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076082_0.png treat image : temp/1764665428_868293_1397281439_4e4eaa93358ad21a2713a090d2b1a2f9_rle_crop_4054076086_0.png treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076090_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076093_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076096_0.png treat image : temp/1764665428_868293_1397281433_4a1c7d7dd8f7dd1e155e70a95fdbc877_rle_crop_4054076104_0.png treat image : temp/1764665428_868293_1397281430_8bfa21a019b1593bac44d2087d840d29_rle_crop_4054076110_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076113_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076114_0.png treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076118_0.png treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076119_0.png treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076122_0.png treat image : temp/1764665428_868293_1397281416_187f3f900deacf3bdd59d9257582a542_rle_crop_4054076124_0.png treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076129_0.png treat image : temp/1764665428_868293_1397281413_7dca1ae3f9c25525f7032ea0cf316e26_rle_crop_4054076130_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076067_0.png treat image : temp/1764665428_868293_1397281455_e752bb000cdfb33364837444e294cd25_rle_crop_4054076070_0.png treat image : temp/1764665428_868293_1397281438_3217fa05258eece283e875b1d794fea7_rle_crop_4054076091_0.png treat image : temp/1764665428_868293_1397281436_bc86cf1240cacceb232a4517dc624507_rle_crop_4054076101_0.png treat image : temp/1764665428_868293_1397281424_586bb99f9e56ab2d918581753cfbdb48_rle_crop_4054076116_0.png treat image : temp/1764665428_868293_1397281423_48dafee87b9e30e1922edbb4afd69d8e_rle_crop_4054076121_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.020900726318359375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.03419899940490723 save missing photos in datou_result : time spend for datou_step_exec : 17.65063762664795 time spend to save output : 0.06130790710449219 total time spend for step 7 : 17.71194553375244 step8:velours_tree Tue Dec 2 09:56:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3462820053100586 time spend to save output : 6.747245788574219e-05 total time spend for step 8 : 0.34634947776794434 step9:send_mail_cod Tue Dec 2 09:56:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29081012_02-12-2025_09_56_59.pdf 29081489 imagette290814891764665819 29081490 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290814901764665819 29081491 imagette290814911764665820 29081492 imagette290814921764665820 29081493 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290814931764665820 29081494 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290814941764665822 29081495 imagette290814951764665823 29081496 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290814961764665823 29081497 imagette290814971764665825 29081498 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette290814981764665825 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29081012 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29081488,29081489,29081490,29081491,29081492,29081493,29081494,29081495,29081496,29081497,29081498?tags=environnement,mal_croppe,carton,pehd,pet_fonce,papier,autre,background,pet_clair,flou,metal your option no_mail is active, we will not send the real mail to your client args[1397281457] : ((1397281457, -6.375111336417485, 492609224), (1397281457, -0.7095452638066225, 501862349), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281456] : ((1397281456, -6.815602478391867, 492609224), (1397281456, -0.4060595549856104, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281455] : ((1397281455, -6.980560335588365, 492609224), (1397281455, -0.41065187579589385, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281452] : ((1397281452, -6.907836202349337, 492609224), (1397281452, -0.34689504256551335, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281449] : ((1397281449, -6.840877755063205, 492609224), (1397281449, -0.16272086347593148, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281441] : ((1397281441, -6.891220430170846, 492609224), (1397281441, -0.4777740941649449, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281439] : ((1397281439, -6.998751616040508, 492609224), (1397281439, -0.3645111838327242, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281438] : ((1397281438, -7.240941441256631, 492609224), (1397281438, -0.2986374708517794, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281436] : ((1397281436, -6.936043942470375, 492609224), (1397281436, -0.3365871311268688, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281433] : ((1397281433, -6.927784257505085, 492609224), (1397281433, -0.38507928348852954, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281430] : ((1397281430, -7.046207207632433, 492609224), (1397281430, -0.21386919233689486, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281424] : ((1397281424, -7.027529594473723, 492609224), (1397281424, -0.3754014090339833, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281423] : ((1397281423, -6.349068101597018, 492609224), (1397281423, -0.7520613557739141, 501862349), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281416] : ((1397281416, -6.63066380770523, 492609224), (1397281416, -0.4533508153740649, 496442774), '0.03496575199331276') We are sending mail with results at report@fotonower.com args[1397281413] : ((1397281413, -6.2047274140152515, 492609224), (1397281413, -1.222044355672572, 501862349), '0.03496575199331276') We are sending mail with results at report@fotonower.com refus_total : 0.03496575199331276 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29081012 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081012_02-12-2025_09_56_59.pdf results_Auto_P29081012_02-12-2025_09_56_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081012_02-12-2025_09_56_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29081012','results_Auto_P29081012_02-12-2025_09_56_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081012_02-12-2025_09_56_59.pdf','pdf','','0.88','0.03496575199331276') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1397281457, 1397281456, 1397281455, 1397281452, 1397281449, 1397281441, 1397281439, 1397281438, 1397281436, 1397281433, 1397281430, 1397281424, 1397281423, 1397281416, 1397281413] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281457', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281456', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281455', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281452', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281449', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281441', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281439', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281438', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281436', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281433', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281430', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281424', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281423', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281416', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281413', None, None, None, None, None, '4170144') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.01830124855041504 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.36645245552063 time spend to save output : 0.018523216247558594 total time spend for step 9 : 11.384975671768188 step10:split_time_score Tue Dec 2 09:57:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('06', 15),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02122025 29081012 Nombre de photos uploadées : 15 / 23040 (0%) 02122025 29081012 Nombre de photos taguées (types de déchets): 0 / 15 (0%) 02122025 29081012 Nombre de photos taguées (volume) : 0 / 15 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 6.67572021484375e-06 ??????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007305145263671875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2621941566467285 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03496575199331276 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29081012_02-12-2025_09_56_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29081012 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081033 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081038 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29081075 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02122025': {'nb_upload': 15, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1397281457, 1397281456, 1397281455, 1397281452, 1397281449, 1397281441, 1397281439, 1397281438, 1397281436, 1397281433, 1397281430, 1397281424, 1397281423, 1397281416, 1397281413] Looping around the photos to save general results len do output : 1 /29081012Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281457', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281456', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281455', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281452', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281449', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281441', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281439', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281438', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281436', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281433', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281430', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281424', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281423', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281416', None, None, None, None, None, '4170144') ('3318', None, None, None, None, None, None, None, '4170144') ('3318', '29081012', '1397281413', None, None, None, None, None, '4170144') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.018860578536987305 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.3633551597595215 time spend to save output : 0.019208669662475586 total time spend for step 10 : 4.382563829421997 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 15 set_done_treatment 151.19user 209.37system 6:49.62elapsed 88%CPU (0avgtext+0avgdata 4183084maxresident)k 2509952inputs+127568outputs (55097major+14822155minor)pagefaults 0swaps