python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2129916 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4257822'] with mtr_portfolio_ids : ['29616374'] and first list_photo_ids : [] new path : /proc/2129916/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.2946033477783203 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Dec 22 14:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-22 14:10:34.408344: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-22 14:10:34.438449: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-22 14:10:34.440504: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7b0c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-22 14:10:34.440553: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-22 14:10:34.444376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-22 14:10:34.668745: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3530c270 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-22 14:10:34.668780: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-22 14:10:34.669951: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-22 14:10:34.670500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-22 14:10:34.674046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-22 14:10:34.691444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-22 14:10:34.692812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-22 14:10:34.721234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-22 14:10:34.724977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-22 14:10:34.775677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-22 14:10:34.777206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-22 14:10:34.777587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-22 14:10:34.778346: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-22 14:10:34.778363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-22 14:10:34.778372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-22 14:10:34.780076: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-22 14:10:35.093299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-22 14:10:35.093412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-22 14:10:35.093430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-22 14:10:35.093444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-22 14:10:35.093457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-22 14:10:35.093470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-22 14:10:35.093483: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-22 14:10:35.093497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-22 14:10:35.094689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-22 14:10:35.096005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-22 14:10:35.096042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-22 14:10:35.096060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-22 14:10:35.096076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-22 14:10:35.096091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-22 14:10:35.096107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-22 14:10:35.096122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-22 14:10:35.096138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-22 14:10:35.097314: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-22 14:10:35.097353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-22 14:10:35.097362: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-22 14:10:35.097369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-22 14:10:35.098606: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-22 14:10:48.979596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-22 14:10:49.181035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 2130440 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 248 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [2034, 1398, 2154, 1638] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005080699920654297 nb_pixel_total : 22179 time to create 1 rle with old method : 0.025908708572387695 length of segment : 120 DEBUG bbox = [1830, 2454, 1932, 2562] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 7037 time to create 1 rle with old method : 0.008170843124389648 length of segment : 93 DEBUG bbox = [1440, 2874, 1866, 3168] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002012491226196289 nb_pixel_total : 75620 time to create 1 rle with old method : 0.08400797843933105 length of segment : 418 DEBUG bbox = [522, 1686, 960, 2076] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003126859664916992 nb_pixel_total : 88254 time to create 1 rle with old method : 0.10692501068115234 length of segment : 427 DEBUG bbox = [504, 1956, 960, 2712] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004656791687011719 nb_pixel_total : 164074 time to create 1 rle with new method : 0.011266469955444336 length of segment : 621 DEBUG bbox = [642, 1416, 1140, 1854] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002367258071899414 nb_pixel_total : 130428 time to create 1 rle with old method : 0.14616918563842773 length of segment : 475 DEBUG bbox = [348, 2472, 588, 2754] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008361339569091797 nb_pixel_total : 39265 time to create 1 rle with old method : 0.045499563217163086 length of segment : 213 DEBUG bbox = [1866, 1002, 2148, 1374] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010099411010742188 nb_pixel_total : 52583 time to create 1 rle with old method : 0.06260251998901367 length of segment : 257 DEBUG bbox = [0, 2334, 408, 2838] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002469778060913086 nb_pixel_total : 110611 time to create 1 rle with old method : 0.12710237503051758 length of segment : 674 DEBUG bbox = [486, 1974, 918, 2700] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024843215942382812 nb_pixel_total : 168249 time to create 1 rle with new method : 0.00940251350402832 length of segment : 525 DEBUG bbox = [1536, 1842, 1788, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 43659 time to create 1 rle with old method : 0.055641889572143555 length of segment : 223 DEBUG bbox = [1158, 2586, 1356, 2832] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007224082946777344 nb_pixel_total : 25872 time to create 1 rle with old method : 0.031363487243652344 length of segment : 207 DEBUG bbox = [1074, 210, 1758, 714] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003464937210083008 nb_pixel_total : 218946 time to create 1 rle with new method : 0.011560201644897461 length of segment : 626 DEBUG bbox = [1698, 1890, 1914, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 23029 time to create 1 rle with old method : 0.029578208923339844 length of segment : 212 DEBUG bbox = [606, 1758, 900, 2154] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015425682067871094 nb_pixel_total : 79350 time to create 1 rle with old method : 0.10223031044006348 length of segment : 273 DEBUG bbox = [2052, 1230, 2154, 1434] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 12899 time to create 1 rle with old method : 0.015660524368286133 length of segment : 97 DEBUG bbox = [1002, 1716, 1248, 1908] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 24605 time to create 1 rle with old method : 0.029775381088256836 length of segment : 206 DEBUG bbox = [240, 48, 546, 216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005605220794677734 nb_pixel_total : 33397 time to create 1 rle with old method : 0.03971385955810547 length of segment : 278 DEBUG bbox = [2028, 1236, 2148, 1524] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003311634063720703 nb_pixel_total : 21572 time to create 1 rle with old method : 0.026328325271606445 length of segment : 111 DEBUG bbox = [210, 816, 384, 1182] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005273818969726562 nb_pixel_total : 34166 time to create 1 rle with old method : 0.045500993728637695 length of segment : 157 DEBUG bbox = [750, 2304, 906, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006537437438964844 nb_pixel_total : 22124 time to create 1 rle with old method : 0.02681589126586914 length of segment : 143 DEBUG bbox = [402, 1164, 882, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0037963390350341797 nb_pixel_total : 128621 time to create 1 rle with old method : 0.1799769401550293 length of segment : 425 DEBUG bbox = [300, 384, 642, 1002] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0028679370880126953 nb_pixel_total : 54065 time to create 1 rle with old method : 0.0675954818725586 length of segment : 299 DEBUG bbox = [6, 1608, 90, 1722] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 6720 time to create 1 rle with old method : 0.008213520050048828 length of segment : 77 DEBUG bbox = [1998, 1704, 2154, 2100] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010976791381835938 nb_pixel_total : 40837 time to create 1 rle with old method : 0.04909062385559082 length of segment : 172 DEBUG bbox = [1338, 300, 1776, 780] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003322124481201172 nb_pixel_total : 95767 time to create 1 rle with old method : 0.1109917163848877 length of segment : 484 DEBUG bbox = [144, 90, 924, 888] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.008600950241088867 nb_pixel_total : 243448 time to create 1 rle with new method : 0.029596328735351562 length of segment : 766 DEBUG bbox = [1584, 1650, 1938, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009834766387939453 nb_pixel_total : 31862 time to create 1 rle with old method : 0.036664724349975586 length of segment : 330 DEBUG bbox = [594, 498, 816, 690] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007724761962890625 nb_pixel_total : 18895 time to create 1 rle with old method : 0.02147674560546875 length of segment : 200 DEBUG bbox = [36, 0, 336, 264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012297630310058594 nb_pixel_total : 48133 time to create 1 rle with old method : 0.055373430252075195 length of segment : 280 DEBUG bbox = [192, 1794, 396, 1962] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006887912750244141 nb_pixel_total : 21240 time to create 1 rle with old method : 0.025164127349853516 length of segment : 170 DEBUG bbox = [1164, 2412, 1410, 2586] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007357597351074219 nb_pixel_total : 19658 time to create 1 rle with old method : 0.02516484260559082 length of segment : 233 DEBUG bbox = [708, 2952, 954, 3138] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 26186 time to create 1 rle with old method : 0.03017282485961914 length of segment : 236 DEBUG bbox = [864, 3090, 984, 3210] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000244140625 nb_pixel_total : 9390 time to create 1 rle with old method : 0.011107683181762695 length of segment : 107 DEBUG bbox = [1152, 1296, 1326, 1458] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006284713745117188 nb_pixel_total : 21551 time to create 1 rle with old method : 0.025676965713500977 length of segment : 165 DEBUG bbox = [1734, 2532, 1908, 2622] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045490264892578125 nb_pixel_total : 9869 time to create 1 rle with old method : 0.01202082633972168 length of segment : 157 DEBUG bbox = [2010, 666, 2148, 864] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 20024 time to create 1 rle with old method : 0.02411031723022461 length of segment : 137 DEBUG bbox = [708, 672, 840, 834] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 11098 time to create 1 rle with old method : 0.014019966125488281 length of segment : 108 DEBUG bbox = [24, 2214, 156, 2382] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 15833 time to create 1 rle with old method : 0.020329713821411133 length of segment : 132 DEBUG bbox = [1338, 798, 1542, 960] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008718967437744141 nb_pixel_total : 19791 time to create 1 rle with old method : 0.02412724494934082 length of segment : 165 DEBUG bbox = [930, 1698, 1332, 2214] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0026111602783203125 nb_pixel_total : 91870 time to create 1 rle with old method : 0.10753250122070312 length of segment : 457 DEBUG bbox = [330, 2994, 558, 3180] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008330345153808594 nb_pixel_total : 25563 time to create 1 rle with old method : 0.032332658767700195 length of segment : 210 DEBUG bbox = [1074, 2640, 1314, 2844] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010149478912353516 nb_pixel_total : 33077 time to create 1 rle with old method : 0.039507389068603516 length of segment : 222 DEBUG bbox = [714, 2838, 864, 3018] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 16013 time to create 1 rle with old method : 0.019180774688720703 length of segment : 143 DEBUG bbox = [612, 732, 1158, 1290] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004817485809326172 nb_pixel_total : 196629 time to create 1 rle with new method : 0.009402036666870117 length of segment : 511 DEBUG bbox = [1914, 474, 2064, 612] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006074905395507812 nb_pixel_total : 13866 time to create 1 rle with old method : 0.01696181297302246 length of segment : 144 DEBUG bbox = [1698, 1716, 2154, 2094] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031130313873291016 nb_pixel_total : 120058 time to create 1 rle with old method : 0.14020252227783203 length of segment : 451 DEBUG bbox = [1482, 1254, 1812, 1710] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003007650375366211 nb_pixel_total : 76573 time to create 1 rle with old method : 0.09275078773498535 length of segment : 292 DEBUG bbox = [1758, 1398, 2136, 1674] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015702247619628906 nb_pixel_total : 69749 time to create 1 rle with old method : 0.07805395126342773 length of segment : 363 DEBUG bbox = [174, 1872, 426, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006835460662841797 nb_pixel_total : 15297 time to create 1 rle with old method : 0.01801156997680664 length of segment : 225 DEBUG bbox = [1140, 1332, 1530, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025861263275146484 nb_pixel_total : 92578 time to create 1 rle with old method : 0.10439753532409668 length of segment : 436 DEBUG bbox = [1692, 1662, 2124, 2112] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017445087432861328 nb_pixel_total : 111540 time to create 1 rle with old method : 0.12743449211120605 length of segment : 444 DEBUG bbox = [1170, 1806, 1590, 2280] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030336380004882812 nb_pixel_total : 86282 time to create 1 rle with old method : 0.09831500053405762 length of segment : 384 DEBUG bbox = [1014, 2964, 1170, 3120] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005915164947509766 nb_pixel_total : 14660 time to create 1 rle with old method : 0.01732945442199707 length of segment : 142 DEBUG bbox = [42, 2862, 696, 3288] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0050945281982421875 nb_pixel_total : 125616 time to create 1 rle with old method : 0.14411258697509766 length of segment : 610 DEBUG bbox = [1506, 2436, 1890, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004048824310302734 nb_pixel_total : 145638 time to create 1 rle with old method : 0.1681959629058838 length of segment : 411 DEBUG bbox = [498, 12, 990, 156] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016002655029296875 nb_pixel_total : 36921 time to create 1 rle with old method : 0.040802717208862305 length of segment : 511 DEBUG bbox = [1272, 1284, 1524, 1560] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001241922378540039 nb_pixel_total : 36661 time to create 1 rle with old method : 0.04280972480773926 length of segment : 226 DEBUG bbox = [1842, 2484, 2160, 2814] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019235610961914062 nb_pixel_total : 86922 time to create 1 rle with old method : 0.0988309383392334 length of segment : 401 DEBUG bbox = [216, 2844, 360, 2946] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 8311 time to create 1 rle with old method : 0.00961160659790039 length of segment : 137 DEBUG bbox = [924, 1464, 1458, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004830598831176758 nb_pixel_total : 192216 time to create 1 rle with new method : 0.010525941848754883 length of segment : 469 DEBUG bbox = [1962, 624, 2160, 834] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007956027984619141 nb_pixel_total : 18931 time to create 1 rle with old method : 0.021855831146240234 length of segment : 185 DEBUG bbox = [54, 2826, 306, 2964] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 17310 time to create 1 rle with old method : 0.019980430603027344 length of segment : 186 DEBUG bbox = [978, 390, 1122, 564] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005383491516113281 nb_pixel_total : 14990 time to create 1 rle with old method : 0.018563270568847656 length of segment : 140 DEBUG bbox = [1596, 1968, 1782, 2094] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 16797 time to create 1 rle with old method : 0.019849777221679688 length of segment : 184 DEBUG bbox = [1044, 1872, 1194, 1998] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00044798851013183594 nb_pixel_total : 12248 time to create 1 rle with old method : 0.014281272888183594 length of segment : 144 DEBUG bbox = [618, 1266, 870, 1584] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001329660415649414 nb_pixel_total : 35051 time to create 1 rle with old method : 0.04406404495239258 length of segment : 229 DEBUG bbox = [258, 2244, 600, 2442] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014538764953613281 nb_pixel_total : 45546 time to create 1 rle with old method : 0.05321550369262695 length of segment : 308 DEBUG bbox = [162, 3126, 528, 3330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015687942504882812 nb_pixel_total : 42784 time to create 1 rle with old method : 0.049398183822631836 length of segment : 358 DEBUG bbox = [1518, 288, 1782, 480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010559558868408203 nb_pixel_total : 33629 time to create 1 rle with old method : 0.039832115173339844 length of segment : 263 DEBUG bbox = [1200, 1338, 1812, 1986] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005445003509521484 nb_pixel_total : 143444 time to create 1 rle with old method : 0.17053961753845215 length of segment : 560 DEBUG bbox = [960, 1980, 1086, 2142] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 15051 time to create 1 rle with old method : 0.01854729652404785 length of segment : 126 DEBUG bbox = [660, 1920, 840, 2160] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008900165557861328 nb_pixel_total : 27397 time to create 1 rle with old method : 0.03292417526245117 length of segment : 157 DEBUG bbox = [318, 2058, 528, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006494522094726562 nb_pixel_total : 29303 time to create 1 rle with old method : 0.034812211990356445 length of segment : 209 DEBUG bbox = [1062, 2718, 1254, 2910] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007541179656982422 nb_pixel_total : 26498 time to create 1 rle with old method : 0.031597137451171875 length of segment : 183 DEBUG bbox = [696, 1170, 1140, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036187171936035156 nb_pixel_total : 137808 time to create 1 rle with old method : 0.18790578842163086 length of segment : 615 DEBUG bbox = [696, 1752, 1116, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021240711212158203 nb_pixel_total : 111827 time to create 1 rle with old method : 0.12989377975463867 length of segment : 397 DEBUG bbox = [1020, 2364, 1218, 2640] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 33035 time to create 1 rle with old method : 0.0381929874420166 length of segment : 194 DEBUG bbox = [1794, 2730, 2136, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012445449829101562 nb_pixel_total : 41208 time to create 1 rle with old method : 0.04820966720581055 length of segment : 312 DEBUG bbox = [420, 252, 750, 444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 34150 time to create 1 rle with old method : 0.03893399238586426 length of segment : 275 DEBUG bbox = [1860, 2214, 2130, 2514] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011277198791503906 nb_pixel_total : 46716 time to create 1 rle with old method : 0.05429792404174805 length of segment : 239 DEBUG bbox = [1878, 1728, 1998, 1854] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 8531 time to create 1 rle with old method : 0.010138511657714844 length of segment : 105 DEBUG bbox = [522, 1314, 666, 1578] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005297660827636719 nb_pixel_total : 20140 time to create 1 rle with old method : 0.023041486740112305 length of segment : 143 DEBUG bbox = [1116, 852, 1398, 1074] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009372234344482422 nb_pixel_total : 40042 time to create 1 rle with old method : 0.04575324058532715 length of segment : 252 DEBUG bbox = [1908, 1062, 2136, 1224] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006458759307861328 nb_pixel_total : 16950 time to create 1 rle with old method : 0.020203590393066406 length of segment : 232 DEBUG bbox = [1026, 2832, 1206, 3036] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006160736083984375 nb_pixel_total : 23136 time to create 1 rle with old method : 0.028609514236450195 length of segment : 171 DEBUG bbox = [648, 1188, 900, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010209083557128906 nb_pixel_total : 41084 time to create 1 rle with old method : 0.04696369171142578 length of segment : 206 DEBUG bbox = [1002, 1182, 1656, 1920] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005228757858276367 nb_pixel_total : 219413 time to create 1 rle with new method : 0.013936519622802734 length of segment : 592 DEBUG bbox = [1218, 540, 1572, 870] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014564990997314453 nb_pixel_total : 58307 time to create 1 rle with old method : 0.06904482841491699 length of segment : 338 DEBUG bbox = [726, 2274, 876, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 9705 time to create 1 rle with old method : 0.011719226837158203 length of segment : 132 time spent for convertir_results : 8.495253562927246 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 90 chid ids of type : 3594 Number RLEs to save : 25623 save missing photos in datou_result : time spend for datou_step_exec : 69.99055600166321 time spend to save output : 1.6643240451812744 total time spend for step 1 : 71.65488004684448 step2:crop_condition Mon Dec 22 14:11:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 90 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3736932 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766409118_2129916 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076425_0.png', 0, 220, 117, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076427_0.png', 0, 253, 388, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076428_0.png', 0, 352, 422, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076429_0.png', 0, 678, 451, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076430_0.png', 0, 405, 473, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076433_0.png', 0, 459, 385, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076435_0.png', 0, 291, 217, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076436_0.png', 0, 237, 194, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076437_0.png', 0, 491, 625, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076438_0.png', 0, 208, 212, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076440_0.png', 0, 178, 97, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076441_0.png', 0, 171, 202, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076443_0.png', 0, 273, 107, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076445_0.png', 0, 215, 143, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076446_0.png', 0, 469, 425, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076449_0.png', 0, 380, 150, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076450_0.png', 0, 475, 352, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076452_0.png', 0, 126, 330, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076459_0.png', 0, 161, 165, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076460_0.png', 0, 80, 157, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076462_0.png', 0, 148, 108, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593_rle_crop_4078076465_0.png', 0, 489, 367, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076469_0.png', 0, 540, 508, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076470_0.png', 0, 128, 144, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076472_0.png', 0, 405, 282, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076474_0.png', 0, 97, 213, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076475_0.png', 0, 416, 358, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076476_0.png', 0, 427, 407, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076481_0.png', 0, 117, 470, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076482_0.png', 0, 271, 210, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076484_0.png', 0, 98, 121, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076485_0.png', 0, 606, 469, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076486_0.png', 0, 203, 185, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076487_0.png', 0, 135, 184, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076489_0.png', 0, 117, 184, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076490_0.png', 0, 101, 144, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076491_0.png', 0, 312, 229, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076492_0.png', 0, 197, 306, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076495_0.png', 0, 615, 502, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076496_0.png', 0, 152, 119, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076497_0.png', 0, 228, 154, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076500_0.png', 0, 654, 406, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076501_0.png', 0, 439, 391, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076502_0.png', 0, 267, 181, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076505_0.png', 0, 279, 239, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076506_0.png', 0, 120, 104, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076508_0.png', 0, 207, 252, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076509_0.png', 0, 151, 225, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076512_0.png', 0, 666, 584, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076513_0.png', 0, 314, 332, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409128), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076514_0.png', 0, 130, 132, 0, 1766409128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 51 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.70267915725708 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766409134_2129916 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076431_0.png', 0, 240, 213, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076442_0.png', 0, 160, 278, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076453_0.png', 0, 158, 196, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076454_0.png', 0, 246, 279, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076456_0.png', 0, 131, 233, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076464_0.png', 0, 153, 165, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076467_0.png', 0, 192, 222, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076468_0.png', 0, 167, 143, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076507_0.png', 0, 218, 140, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409136), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076511_0.png', 0, 244, 203, 0, 1766409136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7976388931274414 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766409139_2129916 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409140), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076461_0.png', 0, 192, 137, 0, 1766409140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409140), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076463_0.png', 0, 165, 128, 0, 1766409140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409140), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593_rle_crop_4078076466_0.png', 0, 146, 210, 0, 1766409140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409140), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076488_0.png', 0, 135, 140, 0, 1766409140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409140), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076498_0.png', 0, 173, 209, 0, 1766409140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409140), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076510_0.png', 0, 175, 171, 0, 1766409140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5966601371765137 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766409148_2129916 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076432_0.png', 0, 310, 246, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076434_0.png', 0, 688, 422, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076439_0.png', 0, 391, 271, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076444_0.png', 0, 301, 157, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076447_0.png', 0, 276, 290, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076448_0.png', 0, 111, 75, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076451_0.png', 0, 640, 595, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076455_0.png', 0, 166, 170, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076471_0.png', 0, 377, 450, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076473_0.png', 0, 273, 360, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076477_0.png', 0, 400, 343, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076479_0.png', 0, 356, 524, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076493_0.png', 0, 167, 358, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076503_0.png', 0, 252, 312, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409151), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076504_0.png', 0, 172, 271, 0, 1766409151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.9596107006073 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766409155_2129916 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076426_0.png', 0, 96, 93, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076457_0.png', 0, 138, 236, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076458_0.png', 0, 115, 103, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076478_0.png', 0, 133, 142, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076480_0.png', 0, 592, 341, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076483_0.png', 0, 328, 304, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409156), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076499_0.png', 0, 167, 180, 0, 1766409156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.042552947998047 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766409159_2129916 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766409159), 0.0, 0.0, 14, '', 0, 0, '1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076494_0.png', 0, 174, 263, 0, 1766409159,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7338171005249023 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1400525349, 1400525344, 1400525342, 1400525341, 1400525340, 1400525339, 1400525338, 1400525329, 1400525328, 1400525327, 1400525326] Looping around the photos to save general results len do output : 90 /1400527677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1400527916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525349', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525344', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525342', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525341', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525340', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525339', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525338', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525329', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525328', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525327', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525326', None, None, None, None, None, '4257822') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 281 time used for this insertion : 0.046625375747680664 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.426843881607056 time spend to save output : 0.05031871795654297 total time spend for step 2 : 57.4771625995636 step3:rle_unique_nms_with_priority Mon Dec 22 14:12:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 90 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 5.7193286418914795 time for calcul the mask position with numpy : 0.5447628498077393 nb_pixel_total : 7543314 time to create 1 rle with new method : 0.6686103343963623 time for calcul the mask position with numpy : 0.02516937255859375 nb_pixel_total : 43659 time to create 1 rle with old method : 0.05403399467468262 time for calcul the mask position with numpy : 0.026849746704101562 nb_pixel_total : 17800 time to create 1 rle with old method : 0.021274805068969727 time for calcul the mask position with numpy : 0.025847196578979492 nb_pixel_total : 110187 time to create 1 rle with old method : 0.13527655601501465 time for calcul the mask position with numpy : 0.028083324432373047 nb_pixel_total : 52583 time to create 1 rle with old method : 0.06495356559753418 time for calcul the mask position with numpy : 0.024029970169067383 nb_pixel_total : 39265 time to create 1 rle with old method : 0.04450678825378418 time for calcul the mask position with numpy : 0.025350332260131836 nb_pixel_total : 130428 time to create 1 rle with old method : 0.14441776275634766 time for calcul the mask position with numpy : 0.028142452239990234 nb_pixel_total : 164074 time to create 1 rle with new method : 0.874514102935791 time for calcul the mask position with numpy : 0.026878833770751953 nb_pixel_total : 88254 time to create 1 rle with old method : 0.10369539260864258 time for calcul the mask position with numpy : 0.02742481231689453 nb_pixel_total : 75620 time to create 1 rle with old method : 0.08835268020629883 time for calcul the mask position with numpy : 0.025606155395507812 nb_pixel_total : 7037 time to create 1 rle with old method : 0.008365631103515625 time for calcul the mask position with numpy : 0.029421091079711914 nb_pixel_total : 22179 time to create 1 rle with old method : 0.02609872817993164 create new chi : 3.137197971343994 time to delete rle : 0.022112369537353516 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++Number RLEs to save : 9776 TO DO : save crop sub photo not yet done ! save time : 0.6603066921234131 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.351358652114868 time for calcul the mask position with numpy : 0.35830044746398926 nb_pixel_total : 7909699 time to create 1 rle with new method : 0.9753320217132568 time for calcul the mask position with numpy : 0.02397441864013672 nb_pixel_total : 24605 time to create 1 rle with old method : 0.02814626693725586 time for calcul the mask position with numpy : 0.026127099990844727 nb_pixel_total : 12899 time to create 1 rle with old method : 0.015140771865844727 time for calcul the mask position with numpy : 0.026463747024536133 nb_pixel_total : 79350 time to create 1 rle with old method : 0.0924079418182373 time for calcul the mask position with numpy : 0.026178359985351562 nb_pixel_total : 23029 time to create 1 rle with old method : 0.025698184967041016 time for calcul the mask position with numpy : 0.02465534210205078 nb_pixel_total : 218946 time to create 1 rle with new method : 0.785938024520874 time for calcul the mask position with numpy : 0.026170730590820312 nb_pixel_total : 25872 time to create 1 rle with old method : 0.029358863830566406 create new chi : 2.531731128692627 time to delete rle : 0.0007677078247070312 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5402 TO DO : save crop sub photo not yet done ! save time : 0.40491366386413574 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.305546045303345 time for calcul the mask position with numpy : 0.7190251350402832 nb_pixel_total : 7680003 time to create 1 rle with new method : 1.031740665435791 time for calcul the mask position with numpy : 0.04247426986694336 nb_pixel_total : 177128 time to create 1 rle with new method : 0.9384708404541016 time for calcul the mask position with numpy : 0.028183460235595703 nb_pixel_total : 95767 time to create 1 rle with old method : 0.11164641380310059 time for calcul the mask position with numpy : 0.025873661041259766 nb_pixel_total : 40837 time to create 1 rle with old method : 0.04756283760070801 time for calcul the mask position with numpy : 0.027070045471191406 nb_pixel_total : 6720 time to create 1 rle with old method : 0.007964372634887695 time for calcul the mask position with numpy : 0.02604818344116211 nb_pixel_total : 54065 time to create 1 rle with old method : 0.060721635818481445 time for calcul the mask position with numpy : 0.024782657623291016 nb_pixel_total : 128621 time to create 1 rle with old method : 0.14289283752441406 time for calcul the mask position with numpy : 0.025745153427124023 nb_pixel_total : 22124 time to create 1 rle with old method : 0.025330543518066406 time for calcul the mask position with numpy : 0.027411937713623047 nb_pixel_total : 34166 time to create 1 rle with old method : 0.04027295112609863 time for calcul the mask position with numpy : 0.0273287296295166 nb_pixel_total : 21572 time to create 1 rle with old method : 0.025267362594604492 time for calcul the mask position with numpy : 0.025809526443481445 nb_pixel_total : 33397 time to create 1 rle with old method : 0.037796974182128906 create new chi : 3.538893461227417 time to delete rle : 0.001102447509765625 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7565 TO DO : save crop sub photo not yet done ! save time : 0.5239336490631104 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 3.8687164783477783 time for calcul the mask position with numpy : 0.8500065803527832 nb_pixel_total : 8154612 time to create 1 rle with new method : 0.8309206962585449 time for calcul the mask position with numpy : 0.025647640228271484 nb_pixel_total : 19658 time to create 1 rle with old method : 0.021668434143066406 time for calcul the mask position with numpy : 0.024263381958007812 nb_pixel_total : 21240 time to create 1 rle with old method : 0.024320602416992188 time for calcul the mask position with numpy : 0.02653813362121582 nb_pixel_total : 48133 time to create 1 rle with old method : 0.0547940731048584 time for calcul the mask position with numpy : 0.025855064392089844 nb_pixel_total : 18895 time to create 1 rle with old method : 0.021405696868896484 time for calcul the mask position with numpy : 0.025940656661987305 nb_pixel_total : 31862 time to create 1 rle with old method : 0.036238908767700195 create new chi : 2.0139687061309814 time to delete rle : 0.0006473064422607422 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4586 TO DO : save crop sub photo not yet done ! save time : 0.3500790596008301 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.50093936920166 time for calcul the mask position with numpy : 0.37752771377563477 nb_pixel_total : 8160658 time to create 1 rle with new method : 1.2853243350982666 time for calcul the mask position with numpy : 0.02500128746032715 nb_pixel_total : 19791 time to create 1 rle with old method : 0.02337479591369629 time for calcul the mask position with numpy : 0.02708911895751953 nb_pixel_total : 15833 time to create 1 rle with old method : 0.018393754959106445 time for calcul the mask position with numpy : 0.02559208869934082 nb_pixel_total : 11098 time to create 1 rle with old method : 0.013005495071411133 time for calcul the mask position with numpy : 0.02711033821105957 nb_pixel_total : 20024 time to create 1 rle with old method : 0.023808717727661133 time for calcul the mask position with numpy : 0.027541160583496094 nb_pixel_total : 9869 time to create 1 rle with old method : 0.012331485748291016 time for calcul the mask position with numpy : 0.028894662857055664 nb_pixel_total : 21551 time to create 1 rle with old method : 0.025172948837280273 time for calcul the mask position with numpy : 0.0249783992767334 nb_pixel_total : 9390 time to create 1 rle with old method : 0.01114034652709961 time for calcul the mask position with numpy : 0.024136781692504883 nb_pixel_total : 26186 time to create 1 rle with old method : 0.030247211456298828 create new chi : 2.0766243934631348 time to delete rle : 0.0008096694946289062 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 4574 TO DO : save crop sub photo not yet done ! save time : 0.3359220027923584 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.76474928855896 time for calcul the mask position with numpy : 0.7946550846099854 nb_pixel_total : 8176967 time to create 1 rle with new method : 0.796480655670166 time for calcul the mask position with numpy : 0.023908376693725586 nb_pixel_total : 25563 time to create 1 rle with old method : 0.029416322708129883 time for calcul the mask position with numpy : 0.02678394317626953 nb_pixel_total : 91870 time to create 1 rle with old method : 0.10652351379394531 create new chi : 1.8285491466522217 time to delete rle : 0.0008270740509033203 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3494 TO DO : save crop sub photo not yet done ! save time : 0.25455570220947266 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 6.8834123611450195 time for calcul the mask position with numpy : 0.44736719131469727 nb_pixel_total : 7553388 time to create 1 rle with new method : 1.2697505950927734 time for calcul the mask position with numpy : 0.027479171752929688 nb_pixel_total : 14660 time to create 1 rle with old method : 0.017684221267700195 time for calcul the mask position with numpy : 0.029502153396606445 nb_pixel_total : 86282 time to create 1 rle with old method : 0.11200952529907227 time for calcul the mask position with numpy : 0.02528834342956543 nb_pixel_total : 6230 time to create 1 rle with old method : 0.007828950881958008 time for calcul the mask position with numpy : 0.029636144638061523 nb_pixel_total : 92578 time to create 1 rle with old method : 0.11290144920349121 time for calcul the mask position with numpy : 0.026424884796142578 nb_pixel_total : 15297 time to create 1 rle with old method : 0.01801300048828125 time for calcul the mask position with numpy : 0.026338815689086914 nb_pixel_total : 69749 time to create 1 rle with old method : 0.08427762985229492 time for calcul the mask position with numpy : 0.025675058364868164 nb_pixel_total : 76573 time to create 1 rle with old method : 0.08749794960021973 time for calcul the mask position with numpy : 0.03026580810546875 nb_pixel_total : 120058 time to create 1 rle with old method : 0.1606130599975586 time for calcul the mask position with numpy : 0.032180070877075195 nb_pixel_total : 13866 time to create 1 rle with old method : 0.020703554153442383 time for calcul the mask position with numpy : 0.027889251708984375 nb_pixel_total : 196629 time to create 1 rle with new method : 1.1389555931091309 time for calcul the mask position with numpy : 0.026346206665039062 nb_pixel_total : 16013 time to create 1 rle with old method : 0.0188748836517334 time for calcul the mask position with numpy : 0.02789592742919922 nb_pixel_total : 33077 time to create 1 rle with old method : 0.040421247482299805 create new chi : 3.948516368865967 time to delete rle : 0.0024633407592773438 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9279 TO DO : save crop sub photo not yet done ! save time : 0.6280624866485596 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 6.06404447555542 time for calcul the mask position with numpy : 0.6389365196228027 nb_pixel_total : 7611138 time to create 1 rle with new method : 0.9311745166778564 time for calcul the mask position with numpy : 0.039121389389038086 nb_pixel_total : 14990 time to create 1 rle with old method : 0.01707291603088379 time for calcul the mask position with numpy : 0.03684735298156738 nb_pixel_total : 17310 time to create 1 rle with old method : 0.019472122192382812 time for calcul the mask position with numpy : 0.02679920196533203 nb_pixel_total : 18931 time to create 1 rle with old method : 0.021245241165161133 time for calcul the mask position with numpy : 0.031384944915771484 nb_pixel_total : 192216 time to create 1 rle with new method : 0.9380102157592773 time for calcul the mask position with numpy : 0.03960776329040527 nb_pixel_total : 8057 time to create 1 rle with old method : 0.00916433334350586 time for calcul the mask position with numpy : 0.0420989990234375 nb_pixel_total : 86922 time to create 1 rle with old method : 0.12008023262023926 time for calcul the mask position with numpy : 0.04400181770324707 nb_pixel_total : 36661 time to create 1 rle with old method : 0.04168200492858887 time for calcul the mask position with numpy : 0.03797459602355957 nb_pixel_total : 36921 time to create 1 rle with old method : 0.04270315170288086 time for calcul the mask position with numpy : 0.04113936424255371 nb_pixel_total : 145638 time to create 1 rle with old method : 0.16570615768432617 time for calcul the mask position with numpy : 0.03896737098693848 nb_pixel_total : 125616 time to create 1 rle with old method : 0.14122939109802246 create new chi : 3.5327229499816895 time to delete rle : 0.0020847320556640625 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8640 TO DO : save crop sub photo not yet done ! save time : 0.6081573963165283 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 6.492455005645752 time for calcul the mask position with numpy : 0.6626827716827393 nb_pixel_total : 7866652 time to create 1 rle with new method : 0.8770408630371094 time for calcul the mask position with numpy : 0.025177717208862305 nb_pixel_total : 26498 time to create 1 rle with old method : 0.029561519622802734 time for calcul the mask position with numpy : 0.02577495574951172 nb_pixel_total : 29303 time to create 1 rle with old method : 0.032686471939086914 time for calcul the mask position with numpy : 0.023613929748535156 nb_pixel_total : 27397 time to create 1 rle with old method : 0.03086256980895996 time for calcul the mask position with numpy : 0.024102449417114258 nb_pixel_total : 15051 time to create 1 rle with old method : 0.017214298248291016 time for calcul the mask position with numpy : 0.024657249450683594 nb_pixel_total : 143444 time to create 1 rle with old method : 0.1688857078552246 time for calcul the mask position with numpy : 0.025504112243652344 nb_pixel_total : 33629 time to create 1 rle with old method : 0.03799319267272949 time for calcul the mask position with numpy : 0.025027990341186523 nb_pixel_total : 42784 time to create 1 rle with old method : 0.04718184471130371 time for calcul the mask position with numpy : 0.0239715576171875 nb_pixel_total : 45546 time to create 1 rle with old method : 0.051409006118774414 time for calcul the mask position with numpy : 0.023796796798706055 nb_pixel_total : 35051 time to create 1 rle with old method : 0.03921794891357422 time for calcul the mask position with numpy : 0.03650355339050293 nb_pixel_total : 12248 time to create 1 rle with old method : 0.013889312744140625 time for calcul the mask position with numpy : 0.03587484359741211 nb_pixel_total : 16797 time to create 1 rle with old method : 0.01882004737854004 create new chi : 2.364168167114258 time to delete rle : 0.0012907981872558594 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7602 TO DO : save crop sub photo not yet done ! save time : 0.5682754516601562 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.6776955127716064 time for calcul the mask position with numpy : 0.6328048706054688 nb_pixel_total : 7881125 time to create 1 rle with new method : 0.6909558773040771 time for calcul the mask position with numpy : 0.026892423629760742 nb_pixel_total : 8531 time to create 1 rle with old method : 0.00928640365600586 time for calcul the mask position with numpy : 0.02378106117248535 nb_pixel_total : 46716 time to create 1 rle with old method : 0.05134844779968262 time for calcul the mask position with numpy : 0.02392101287841797 nb_pixel_total : 34150 time to create 1 rle with old method : 0.038072824478149414 time for calcul the mask position with numpy : 0.0233919620513916 nb_pixel_total : 41208 time to create 1 rle with old method : 0.04638957977294922 time for calcul the mask position with numpy : 0.023737430572509766 nb_pixel_total : 33035 time to create 1 rle with old method : 0.03719496726989746 time for calcul the mask position with numpy : 0.029474258422851562 nb_pixel_total : 111827 time to create 1 rle with old method : 0.12405705451965332 time for calcul the mask position with numpy : 0.024465322494506836 nb_pixel_total : 137808 time to create 1 rle with old method : 0.20119118690490723 create new chi : 2.0470712184906006 time to delete rle : 0.0019299983978271484 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6434 TO DO : save crop sub photo not yet done ! save time : 0.4682943820953369 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.390164852142334 time for calcul the mask position with numpy : 0.5895979404449463 nb_pixel_total : 7865623 time to create 1 rle with new method : 0.7395570278167725 time for calcul the mask position with numpy : 0.023936986923217773 nb_pixel_total : 9705 time to create 1 rle with old method : 0.01115727424621582 time for calcul the mask position with numpy : 0.02523660659790039 nb_pixel_total : 58307 time to create 1 rle with old method : 0.06702208518981934 time for calcul the mask position with numpy : 0.025494098663330078 nb_pixel_total : 219413 time to create 1 rle with new method : 0.9278771877288818 time for calcul the mask position with numpy : 0.02359175682067871 nb_pixel_total : 41084 time to create 1 rle with old method : 0.04587507247924805 time for calcul the mask position with numpy : 0.02364516258239746 nb_pixel_total : 23136 time to create 1 rle with old method : 0.026363372802734375 time for calcul the mask position with numpy : 0.024623394012451172 nb_pixel_total : 16950 time to create 1 rle with old method : 0.019292831420898438 time for calcul the mask position with numpy : 0.023841381072998047 nb_pixel_total : 40042 time to create 1 rle with old method : 0.04580211639404297 time for calcul the mask position with numpy : 0.03001570701599121 nb_pixel_total : 20140 time to create 1 rle with old method : 0.023479223251342773 create new chi : 2.764622926712036 time to delete rle : 0.0012180805206298828 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6292 TO DO : save crop sub photo not yet done ! save time : 0.4374666213989258 map_output_result : {1400525349: (0.0, 'Should be the crop_list due to order', 0), 1400525344: (0.0, 'Should be the crop_list due to order', 0), 1400525342: (0.0, 'Should be the crop_list due to order', 0), 1400525341: (0.0, 'Should be the crop_list due to order', 0), 1400525340: (0.0, 'Should be the crop_list due to order', 0), 1400525339: (0.0, 'Should be the crop_list due to order', 0), 1400525338: (0.0, 'Should be the crop_list due to order', 0), 1400525329: (0.0, 'Should be the crop_list due to order', 0), 1400525328: (0.0, 'Should be the crop_list due to order', 0), 1400525327: (0.0, 'Should be the crop_list due to order', 0), 1400525326: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1400525349, 1400525344, 1400525342, 1400525341, 1400525340, 1400525339, 1400525338, 1400525329, 1400525328, 1400525327, 1400525326] Looping around the photos to save general results len do output : 11 /1400525349.Didn't retrieve data . /1400525344.Didn't retrieve data . /1400525342.Didn't retrieve data . /1400525341.Didn't retrieve data . /1400525340.Didn't retrieve data . /1400525339.Didn't retrieve data . /1400525338.Didn't retrieve data . /1400525329.Didn't retrieve data . /1400525328.Didn't retrieve data . /1400525327.Didn't retrieve data . /1400525326.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525349', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525344', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525342', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525341', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525340', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525339', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525338', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525329', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525328', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525327', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525326', None, None, None, None, None, '4257822') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.022408723831176758 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.65705633163452 time spend to save output : 0.022907018661499023 total time spend for step 3 : 88.67996335029602 step4:ventilate_hashtags_in_portfolio Mon Dec 22 14:14:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29616374 get user id for portfolio 29616374 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29616374 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','pehd','flou','autre','environnement','carton','pet_fonce','background','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29616374 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','pehd','flou','autre','environnement','carton','pet_fonce','background','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29616374 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','pehd','flou','autre','environnement','carton','pet_fonce','background','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29616719,29616720,29616721,29616722,29616723,29616724,29616725,29616726,29616727,29616728,29616729?tags=metal,mal_croppe,pehd,flou,autre,environnement,carton,pet_fonce,background,papier,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1400525349, 1400525344, 1400525342, 1400525341, 1400525340, 1400525339, 1400525338, 1400525329, 1400525328, 1400525327, 1400525326] Looping around the photos to save general results len do output : 1 /29616374. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525349', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525344', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525342', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525341', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525340', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525339', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525338', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525329', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525328', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525327', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525326', None, None, None, None, None, '4257822') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.019394874572753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9505908489227295 time spend to save output : 0.019752025604248047 total time spend for step 4 : 1.9703428745269775 step5:final Mon Dec 22 14:14:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1400525349: ('0.05299546024480921',), 1400525344: ('0.05299546024480921',), 1400525342: ('0.05299546024480921',), 1400525341: ('0.05299546024480921',), 1400525340: ('0.05299546024480921',), 1400525339: ('0.05299546024480921',), 1400525338: ('0.05299546024480921',), 1400525329: ('0.05299546024480921',), 1400525328: ('0.05299546024480921',), 1400525327: ('0.05299546024480921',), 1400525326: ('0.05299546024480921',)} new output for save of step final : {1400525349: ('0.05299546024480921',), 1400525344: ('0.05299546024480921',), 1400525342: ('0.05299546024480921',), 1400525341: ('0.05299546024480921',), 1400525340: ('0.05299546024480921',), 1400525339: ('0.05299546024480921',), 1400525338: ('0.05299546024480921',), 1400525329: ('0.05299546024480921',), 1400525328: ('0.05299546024480921',), 1400525327: ('0.05299546024480921',), 1400525326: ('0.05299546024480921',)} [1400525349, 1400525344, 1400525342, 1400525341, 1400525340, 1400525339, 1400525338, 1400525329, 1400525328, 1400525327, 1400525326] Looping around the photos to save general results len do output : 11 /1400525349.Didn't retrieve data . /1400525344.Didn't retrieve data . /1400525342.Didn't retrieve data . /1400525341.Didn't retrieve data . /1400525340.Didn't retrieve data . /1400525339.Didn't retrieve data . /1400525338.Didn't retrieve data . /1400525329.Didn't retrieve data . /1400525328.Didn't retrieve data . /1400525327.Didn't retrieve data . /1400525326.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525349', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525344', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525342', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525341', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525340', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525339', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525338', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525329', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525328', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525327', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525326', None, None, None, None, None, '4257822') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.0177004337310791 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13803863525390625 time spend to save output : 0.01833200454711914 total time spend for step 5 : 0.1563706398010254 step6:blur_detection Mon Dec 22 14:14:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc.jpg resize: (2160, 3840) 1400525349 -7.053576356069854 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663.jpg resize: (2160, 3840) 1400525344 -7.059278291598626 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112.jpg resize: (2160, 3840) 1400525342 -7.097647705418 treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf.jpg resize: (2160, 3840) 1400525341 -6.962685766252585 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099.jpg resize: (2160, 3840) 1400525340 -7.036754503183428 treat image : temp/1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593.jpg resize: (2160, 3840) 1400525339 -7.121871325261979 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e.jpg resize: (2160, 3840) 1400525338 -6.999710373719583 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f.jpg resize: (2160, 3840) 1400525329 -7.060217451684018 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395.jpg resize: (2160, 3840) 1400525328 -7.11300006522808 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b.jpg resize: (2160, 3840) 1400525327 -6.936458706894052 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d.jpg resize: (2160, 3840) 1400525326 -6.9623446911718245 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076425_0.png resize: (117, 220) 1400527677 -6.142147618484631 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076427_0.png resize: (388, 253) 1400527678 -5.14443876457607 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076428_0.png resize: (422, 352) 1400527679 -3.4513302217058173 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076429_0.png resize: (451, 678) 1400527680 -4.885987320838889 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076430_0.png resize: (473, 405) 1400527681 -5.2814691786427765 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076433_0.png resize: (385, 459) 1400527682 -4.272342876667483 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076435_0.png resize: (217, 291) 1400527683 -5.579324306595813 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076436_0.png resize: (194, 237) 1400527684 -4.119702318052483 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076437_0.png resize: (625, 491) 1400527685 -5.532978506844608 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076438_0.png resize: (212, 208) 1400527686 -4.16439703486166 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076440_0.png resize: (97, 178) 1400527687 -5.186773180714867 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076441_0.png resize: (202, 171) 1400527688 -4.890170442230737 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076443_0.png resize: (107, 273) 1400527689 -2.8609297389303263 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076445_0.png resize: (143, 215) 1400527690 -4.152248965894382 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076446_0.png resize: (425, 469) 1400527691 -4.5156186150689575 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076449_0.png resize: (150, 380) 1400527692 -4.721668481167678 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076450_0.png resize: (352, 475) 1400527693 -4.93039578546236 treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076452_0.png resize: (330, 126) 1400527694 -4.699943761653716 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076459_0.png resize: (165, 161) 1400527695 -4.335177126031889 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076460_0.png resize: (157, 80) 1400527696 -3.7054292495729113 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076462_0.png resize: (108, 148) 1400527697 -4.2549547318189544 treat image : temp/1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593_rle_crop_4078076465_0.png resize: (367, 489) 1400527698 -4.640455780596828 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076469_0.png resize: (508, 540) 1400527699 -4.825451669424534 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076470_0.png resize: (144, 128) 1400527700 -4.604079818265561 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076472_0.png resize: (282, 405) 1400527701 -5.094478161898266 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076474_0.png resize: (213, 97) 1400527702 -3.498389221476579 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076475_0.png resize: (358, 416) 1400527703 -3.7716566184083726 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076476_0.png resize: (407, 427) 1400527704 -4.044705027910967 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076481_0.png resize: (470, 117) 1400527705 -2.6556262088218445 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076482_0.png resize: (210, 271) 1400527706 -4.858880966289151 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076484_0.png resize: (121, 98) 1400527707 -4.098722373785691 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076485_0.png resize: (469, 606) 1400527708 -5.491172295607202 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076486_0.png resize: (185, 203) 1400527709 -4.658668860935885 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076487_0.png resize: (184, 135) 1400527710 -3.8534178420773992 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076489_0.png resize: (184, 117) 1400527711 -2.9566497588877754 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076490_0.png resize: (144, 101) 1400527712 -3.13395423305341 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076491_0.png resize: (229, 312) 1400527713 -3.4433716620174186 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076492_0.png resize: (306, 197) 1400527714 -4.638885290662526 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076495_0.png resize: (502, 615) 1400527715 -4.16842122868031 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076496_0.png resize: (119, 152) 1400527716 -3.838826527057248 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076497_0.png resize: (154, 228) 1400527717 -3.903410699503025 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076500_0.png resize: (406, 654) 1400527718 -4.5903630578805545 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076501_0.png resize: (391, 439) 1400527719 -4.65014114600828 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076502_0.png resize: (181, 267) 1400527720 -3.505300409696401 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076505_0.png resize: (239, 279) 1400527721 -4.753151300537191 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076506_0.png resize: (104, 120) 1400527722 -4.320772165470778 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076508_0.png resize: (252, 207) 1400527723 -5.462453363350998 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076509_0.png resize: (225, 151) 1400527724 -4.0278997924510085 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076512_0.png resize: (584, 666) 1400527725 -3.6323207414441803 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076513_0.png resize: (332, 314) 1400527726 -5.821270745320973 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076514_0.png resize: (132, 130) 1400527727 -4.13502949843026 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076431_0.png resize: (213, 240) 1400527734 -3.9234005488066863 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076442_0.png resize: (278, 160) 1400527735 -3.6596688909981667 treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076453_0.png resize: (196, 158) 1400527737 -2.973553445000428 treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076454_0.png resize: (279, 246) 1400527738 -4.9896619040735795 treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076456_0.png resize: (233, 131) 1400527739 -2.693986310049724 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076464_0.png resize: (165, 153) 1400527741 -5.367003731840607 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076467_0.png resize: (222, 192) 1400527742 -3.6967282398420296 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076468_0.png resize: (143, 167) 1400527743 -3.556741900010476 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076507_0.png resize: (140, 218) 1400527745 -1.846769417236768 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076511_0.png resize: (203, 244) 1400527746 -3.604219406263533 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076461_0.png resize: (137, 192) 1400527777 -4.6785476322360235 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076463_0.png resize: (128, 165) 1400527779 -4.312030889373766 treat image : temp/1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593_rle_crop_4078076466_0.png resize: (210, 146) 1400527780 -4.294936445873008 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076488_0.png resize: (140, 135) 1400527781 -4.3446520885370115 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076498_0.png resize: (209, 173) 1400527783 -4.3680567400466055 treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076510_0.png resize: (171, 175) 1400527784 -4.612147410186682 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076432_0.png resize: (246, 310) 1400527870 -5.190234762338422 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076434_0.png resize: (422, 688) 1400527872 -4.973455627030271 treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076439_0.png resize: (271, 391) 1400527873 -4.153843176668141 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076444_0.png resize: (157, 301) 1400527874 -4.148902992023987 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076447_0.png resize: (290, 276) 1400527876 -4.590959750993649 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076448_0.png resize: (75, 111) 1400527877 -4.2452996182720835 treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076451_0.png resize: (595, 640) 1400527878 -5.477029577567552 treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076455_0.png resize: (170, 166) 1400527880 -3.6671971268643557 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076471_0.png resize: (450, 377) 1400527881 -4.134049522152094 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076473_0.png resize: (360, 273) 1400527882 -4.634111482437694 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076477_0.png resize: (343, 400) 1400527884 -5.801630312497731 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076479_0.png resize: (524, 356) 1400527885 -4.649383661581121 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076493_0.png resize: (358, 167) 1400527886 -3.990112207306449 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076503_0.png resize: (312, 252) 1400527888 -5.121786619931272 treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076504_0.png resize: (271, 172) 1400527889 -4.980778138269353 treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076426_0.png resize: (93, 96) 1400527908 -4.913766771574732 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076457_0.png resize: (236, 138) 1400527909 -1.7795896009601186 treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076458_0.png resize: (103, 115) 1400527910 -4.155807318916471 treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076478_0.png resize: (142, 133) 1400527911 -3.6152066688482076 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076480_0.png resize: (341, 592) 1400527912 -5.604292499613111 treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076483_0.png resize: (304, 328) 1400527913 -4.68537956891317 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076499_0.png resize: (180, 167) 1400527914 -3.942136659148902 treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076494_0.png resize: (263, 174) 1400527916 -5.808286697516347 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.020558834075927734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.03221416473388672 save missing photos in datou_result : time spend for datou_step_exec : 42.91321778297424 time spend to save output : 0.059664249420166016 total time spend for step 6 : 42.97288203239441 step7:brightness Mon Dec 22 14:14:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc.jpg treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663.jpg treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112.jpg treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf.jpg treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099.jpg treat image : temp/1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593.jpg treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e.jpg treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f.jpg treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395.jpg treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b.jpg treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d.jpg treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076425_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076427_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076428_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076429_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076430_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076433_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076435_0.png treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076436_0.png treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076437_0.png treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076438_0.png treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076440_0.png treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076441_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076443_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076445_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076446_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076449_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076450_0.png treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076452_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076459_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076460_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076462_0.png treat image : temp/1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593_rle_crop_4078076465_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076469_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076470_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076472_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076474_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076475_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076476_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076481_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076482_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076484_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076485_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076486_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076487_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076489_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076490_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076491_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076492_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076495_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076496_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076497_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076500_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076501_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076502_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076505_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076506_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076508_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076509_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076512_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076513_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076514_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076431_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076442_0.png treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076453_0.png treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076454_0.png treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076456_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076464_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076467_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076468_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076507_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076511_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076461_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076463_0.png treat image : temp/1766409028_2129916_1400525339_18ec161922ee36061943c0f5b2321593_rle_crop_4078076466_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076488_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076498_0.png treat image : temp/1766409028_2129916_1400525326_03bd6c08559d74a16d2c6ecde807381d_rle_crop_4078076510_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076432_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076434_0.png treat image : temp/1766409028_2129916_1400525344_2757dfd07d4571fe23fc912f80232663_rle_crop_4078076439_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076444_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076447_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076448_0.png treat image : temp/1766409028_2129916_1400525342_5d08ce561a58a21b6dcaea37f1f25112_rle_crop_4078076451_0.png treat image : temp/1766409028_2129916_1400525341_c2f2cab2691a2f9897f2624a4074fccf_rle_crop_4078076455_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076471_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076473_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076477_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076479_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076493_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076503_0.png treat image : temp/1766409028_2129916_1400525327_fba5a8d11b3ce327100c50e7d041be2b_rle_crop_4078076504_0.png treat image : temp/1766409028_2129916_1400525349_16f0abba554d7140fb827692de6d58cc_rle_crop_4078076426_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076457_0.png treat image : temp/1766409028_2129916_1400525340_fc8be515a6cb1188691c556082a46099_rle_crop_4078076458_0.png treat image : temp/1766409028_2129916_1400525338_d9cb6fa59496e772bf624e9f8249293e_rle_crop_4078076478_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076480_0.png treat image : temp/1766409028_2129916_1400525329_f63054ff0b4f5f5ff990b238a9e3ce1f_rle_crop_4078076483_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076499_0.png treat image : temp/1766409028_2129916_1400525328_01d8ce67ca162a8addf1239fb4cb1395_rle_crop_4078076494_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 101 time used for this insertion : 0.02273273468017578 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 101 time used for this insertion : 0.034166574478149414 save missing photos in datou_result : time spend for datou_step_exec : 11.543563842773438 time spend to save output : 0.06303644180297852 total time spend for step 7 : 11.606600284576416 step8:velours_tree Mon Dec 22 14:15:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.41861557960510254 time spend to save output : 6.604194641113281e-05 total time spend for step 8 : 0.41868162155151367 step9:send_mail_cod Mon Dec 22 14:15:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29616374_22-12-2025_14_15_05.pdf 29616719 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette296167191766409305 29616720 imagette296167201766409306 29616721 imagette296167211766409306 29616722 imagette296167221766409306 29616723 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette296167231766409306 29616725 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette296167251766409306 29616726 change filename to text .imagette296167261766409307 29616727 imagette296167271766409307 29616728 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette296167281766409308 29616729 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette296167291766409309 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29616374 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29616719,29616720,29616721,29616722,29616723,29616724,29616725,29616726,29616727,29616728,29616729?tags=metal,mal_croppe,pehd,flou,autre,environnement,carton,pet_fonce,background,papier,pet_clair your option no_mail is active, we will not send the real mail to your client args[1400525349] : ((1400525349, -7.053576356069854, 492609224), (1400525349, 0.0303942532475101, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525344] : ((1400525344, -7.059278291598626, 492609224), (1400525344, -0.1057165437164238, 496442774), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525342] : ((1400525342, -7.097647705418, 492609224), (1400525342, 0.01778932493405747, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525341] : ((1400525341, -6.962685766252585, 492609224), (1400525341, -0.12021289937445946, 496442774), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525340] : ((1400525340, -7.036754503183428, 492609224), (1400525340, 0.008248585356297515, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525339] : ((1400525339, -7.121871325261979, 492609224), (1400525339, 0.008376958164077287, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525338] : ((1400525338, -6.999710373719583, 492609224), (1400525338, 0.10498629076406835, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525329] : ((1400525329, -7.060217451684018, 492609224), (1400525329, -0.03905989169528278, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525328] : ((1400525328, -7.11300006522808, 492609224), (1400525328, 0.08453517470295345, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525327] : ((1400525327, -6.936458706894052, 492609224), (1400525327, 0.050941966807998104, 2107752395), '0.05299546024480921') We are sending mail with results at report@fotonower.com args[1400525326] : ((1400525326, -6.9623446911718245, 492609224), (1400525326, -0.1562236783726229, 496442774), '0.05299546024480921') We are sending mail with results at report@fotonower.com refus_total : 0.05299546024480921 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29616374 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29616374_22-12-2025_14_15_05.pdf results_Auto_P29616374_22-12-2025_14_15_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29616374_22-12-2025_14_15_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29616374','results_Auto_P29616374_22-12-2025_14_15_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29616374_22-12-2025_14_15_05.pdf','pdf','','0.79','0.05299546024480921') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1400525349, 1400525344, 1400525342, 1400525341, 1400525340, 1400525339, 1400525338, 1400525329, 1400525328, 1400525327, 1400525326] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525349', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525344', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525342', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525341', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525340', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525339', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525338', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525329', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525328', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525327', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525326', None, None, None, None, None, '4257822') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016875028610229492 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.93466591835022 time spend to save output : 0.017090320587158203 total time spend for step 9 : 9.951756238937378 step10:split_time_score Mon Dec 22 14:15:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22122025 29616374 Nombre de photos uploadées : 11 / 23040 (0%) 22122025 29616374 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 22122025 29616374 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.049041748046875e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005362033843994141 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2376575469970703 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03038540159112724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29612546_22-12-2025_11_08_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29612546 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29612546 AND mptpi.`type`=3726 To do Qualite : 0.005068778309624803 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29615718_22-12-2025_12_35_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29615718 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29615718 AND mptpi.`type`=3726 To do Qualite : 0.030405572064202135 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29615931_22-12-2025_13_08_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29615931 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29615931 AND mptpi.`type`=3726 To do Qualite : 0.05299546024480921 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29616374_22-12-2025_14_15_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29616374 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29616374 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22122025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1400525349, 1400525344, 1400525342, 1400525341, 1400525340, 1400525339, 1400525338, 1400525329, 1400525328, 1400525327, 1400525326] Looping around the photos to save general results len do output : 1 /29616374Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525349', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525344', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525342', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525341', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525340', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525339', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525338', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525329', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525328', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525327', None, None, None, None, None, '4257822') ('3318', None, None, None, None, None, None, None, '4257822') ('3318', '29616374', '1400525326', None, None, None, None, None, '4257822') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.020583629608154297 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7498819828033447 time spend to save output : 0.02087235450744629 total time spend for step 10 : 0.770754337310791 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 122.29user 131.07system 4:50.52elapsed 87%CPU (0avgtext+0avgdata 4946660maxresident)k 2158288inputs+123888outputs (16452major+12378898minor)pagefaults 0swaps