python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2922956 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4275469'] with mtr_portfolio_ids : ['29717684'] and first list_photo_ids : [] new path : /proc/2922956/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5152473449707031 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Dec 26 14:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-12-26 14:10:33.631710: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-12-26 14:10:33.662425: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-12-26 14:10:33.664378: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7a14000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-12-26 14:10:33.664398: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-12-26 14:10:33.668603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-12-26 14:10:33.957035: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4341d6e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-12-26 14:10:33.957083: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-12-26 14:10:33.958387: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-26 14:10:33.960138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 14:10:33.987316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 14:10:34.004527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-26 14:10:34.008312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-26 14:10:34.036748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-26 14:10:34.041011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-26 14:10:34.091100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-26 14:10:34.092669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-26 14:10:34.093040: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 14:10:34.094414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-26 14:10:34.094433: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-26 14:10:34.094442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-26 14:10:34.096088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-12-26 14:10:34.443020: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-26 14:10:34.443135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 14:10:34.443151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 14:10:34.443165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-26 14:10:34.443179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-26 14:10:34.443192: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-26 14:10:34.443205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-26 14:10:34.443219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-26 14:10:34.444382: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-26 14:10:34.445597: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-12-26 14:10:34.445625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-12-26 14:10:34.445639: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 14:10:34.445651: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-12-26 14:10:34.445663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-12-26 14:10:34.445676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-12-26 14:10:34.445688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-12-26 14:10:34.445700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-12-26 14:10:34.446908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-12-26 14:10:34.446949: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-12-26 14:10:34.446959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-12-26 14:10:34.446968: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-12-26 14:10:34.448174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-12-26 14:10:45.560233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-12-26 14:10:45.866267: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 2923534 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1266, 2490, 1896, 2958] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003935813903808594 nb_pixel_total : 126217 time to create 1 rle with old method : 0.1444227695465088 length of segment : 598 DEBUG bbox = [1626, 570, 1920, 810] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006644725799560547 nb_pixel_total : 31962 time to create 1 rle with old method : 0.03791213035583496 length of segment : 341 DEBUG bbox = [2046, 978, 2160, 1446] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006513595581054688 nb_pixel_total : 35974 time to create 1 rle with old method : 0.04655742645263672 length of segment : 106 DEBUG bbox = [1230, 1758, 1668, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004270315170288086 nb_pixel_total : 186185 time to create 1 rle with new method : 0.012381553649902344 length of segment : 685 DEBUG bbox = [1350, 2850, 1674, 3072] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007297992706298828 nb_pixel_total : 38255 time to create 1 rle with old method : 0.04551506042480469 length of segment : 351 DEBUG bbox = [774, 348, 1008, 522] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004374980926513672 nb_pixel_total : 22082 time to create 1 rle with old method : 0.02628493309020996 length of segment : 221 DEBUG bbox = [252, 678, 786, 1068] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019350051879882812 nb_pixel_total : 129236 time to create 1 rle with old method : 0.17417287826538086 length of segment : 574 DEBUG bbox = [540, 366, 756, 468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002541542053222656 nb_pixel_total : 8516 time to create 1 rle with old method : 0.010256528854370117 length of segment : 171 DEBUG bbox = [840, 1872, 1248, 2262] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013747215270996094 nb_pixel_total : 88602 time to create 1 rle with old method : 0.10001754760742188 length of segment : 363 DEBUG bbox = [1686, 2760, 2076, 3054] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00116729736328125 nb_pixel_total : 59479 time to create 1 rle with old method : 0.07131791114807129 length of segment : 415 DEBUG bbox = [1734, 1788, 1950, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046539306640625 nb_pixel_total : 22687 time to create 1 rle with old method : 0.02736830711364746 length of segment : 297 DEBUG bbox = [282, 3150, 420, 3306] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 14255 time to create 1 rle with old method : 0.017189741134643555 length of segment : 126 DEBUG bbox = [18, 3534, 822, 3804] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022194385528564453 nb_pixel_total : 153178 time to create 1 rle with new method : 0.0077130794525146484 length of segment : 740 DEBUG bbox = [1662, 2778, 2112, 3042] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013973712921142578 nb_pixel_total : 59661 time to create 1 rle with old method : 0.06680440902709961 length of segment : 435 DEBUG bbox = [54, 1158, 540, 1608] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001477956771850586 nb_pixel_total : 56588 time to create 1 rle with old method : 0.06417989730834961 length of segment : 645 DEBUG bbox = [714, 2406, 984, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011134147644042969 nb_pixel_total : 68918 time to create 1 rle with old method : 0.07751297950744629 length of segment : 252 DEBUG bbox = [1230, 1044, 1692, 1626] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002689838409423828 nb_pixel_total : 138183 time to create 1 rle with old method : 0.1553952693939209 length of segment : 417 DEBUG bbox = [186, 2130, 390, 2418] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005764961242675781 nb_pixel_total : 16860 time to create 1 rle with old method : 0.02607560157775879 length of segment : 176 DEBUG bbox = [1704, 1542, 1920, 2004] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001447916030883789 nb_pixel_total : 54796 time to create 1 rle with old method : 0.08196616172790527 length of segment : 197 DEBUG bbox = [1062, 1770, 1506, 2442] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004034280776977539 nb_pixel_total : 153383 time to create 1 rle with new method : 0.017279624938964844 length of segment : 406 DEBUG bbox = [1608, 1038, 2022, 1434] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022542476654052734 nb_pixel_total : 66019 time to create 1 rle with old method : 0.10445737838745117 length of segment : 415 DEBUG bbox = [1128, 1404, 1440, 1842] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00327301025390625 nb_pixel_total : 82655 time to create 1 rle with old method : 0.11743664741516113 length of segment : 286 DEBUG bbox = [714, 846, 1212, 1554] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0076580047607421875 nb_pixel_total : 179788 time to create 1 rle with new method : 0.019594669342041016 length of segment : 436 DEBUG bbox = [1410, 2346, 1668, 2790] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017766952514648438 nb_pixel_total : 69978 time to create 1 rle with old method : 0.09349632263183594 length of segment : 238 DEBUG bbox = [1410, 1608, 1632, 1914] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009946823120117188 nb_pixel_total : 30713 time to create 1 rle with old method : 0.040380239486694336 length of segment : 199 DEBUG bbox = [1824, 1488, 2124, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011358261108398438 nb_pixel_total : 59809 time to create 1 rle with old method : 0.06888675689697266 length of segment : 350 DEBUG bbox = [312, 1182, 624, 1398] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013990402221679688 nb_pixel_total : 36340 time to create 1 rle with old method : 0.04000401496887207 length of segment : 325 DEBUG bbox = [102, 0, 2058, 582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.025130033493041992 nb_pixel_total : 367804 time to create 1 rle with new method : 0.0740516185760498 length of segment : 1740 DEBUG bbox = [108, 738, 678, 1020] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.008850812911987305 nb_pixel_total : 114296 time to create 1 rle with old method : 0.13254046440124512 length of segment : 580 DEBUG bbox = [1500, 2010, 2004, 2592] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0049936771392822266 nb_pixel_total : 110407 time to create 1 rle with old method : 0.1273479461669922 length of segment : 616 DEBUG bbox = [930, 2652, 1170, 3042] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014028549194335938 nb_pixel_total : 41929 time to create 1 rle with old method : 0.04858064651489258 length of segment : 215 DEBUG bbox = [576, 1062, 816, 1128] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 8272 time to create 1 rle with old method : 0.013192415237426758 length of segment : 220 DEBUG bbox = [402, 1542, 492, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 5520 time to create 1 rle with old method : 0.01007843017578125 length of segment : 73 DEBUG bbox = [1056, 936, 1344, 1242] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014772415161132812 nb_pixel_total : 45092 time to create 1 rle with old method : 0.0533750057220459 length of segment : 253 DEBUG bbox = [1842, 366, 2010, 528] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002434253692626953 nb_pixel_total : 8186 time to create 1 rle with old method : 0.009552717208862305 length of segment : 136 DEBUG bbox = [390, 780, 630, 960] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007221698760986328 nb_pixel_total : 13918 time to create 1 rle with old method : 0.0165255069732666 length of segment : 205 DEBUG bbox = [90, 360, 492, 768] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002132415771484375 nb_pixel_total : 105608 time to create 1 rle with old method : 0.12028670310974121 length of segment : 389 DEBUG bbox = [2028, 1830, 2154, 2154] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 22177 time to create 1 rle with old method : 0.026819944381713867 length of segment : 113 DEBUG bbox = [132, 3330, 588, 3738] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023255348205566406 nb_pixel_total : 66784 time to create 1 rle with old method : 0.07496953010559082 length of segment : 412 DEBUG bbox = [144, 3294, 576, 3696] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012927055358886719 nb_pixel_total : 74622 time to create 1 rle with old method : 0.08340573310852051 length of segment : 445 DEBUG bbox = [1692, 954, 2106, 1644] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002981901168823242 nb_pixel_total : 95428 time to create 1 rle with old method : 0.10654807090759277 length of segment : 430 DEBUG bbox = [1350, 1680, 1854, 2322] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003908872604370117 nb_pixel_total : 127665 time to create 1 rle with old method : 0.14376401901245117 length of segment : 432 DEBUG bbox = [1860, 1740, 2118, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031976699829101562 nb_pixel_total : 61987 time to create 1 rle with old method : 0.07391095161437988 length of segment : 247 DEBUG bbox = [432, 732, 654, 906] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 25450 time to create 1 rle with old method : 0.0303802490234375 length of segment : 302 DEBUG bbox = [48, 2412, 462, 3228] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004502534866333008 nb_pixel_total : 235462 time to create 1 rle with new method : 0.006856203079223633 length of segment : 461 DEBUG bbox = [618, 2310, 846, 2850] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015902519226074219 nb_pixel_total : 53556 time to create 1 rle with old method : 0.06531572341918945 length of segment : 247 DEBUG bbox = [1416, 48, 2124, 630] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005292177200317383 nb_pixel_total : 257869 time to create 1 rle with new method : 0.009384870529174805 length of segment : 707 DEBUG bbox = [1050, 438, 1254, 696] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008161067962646484 nb_pixel_total : 24211 time to create 1 rle with old method : 0.030370712280273438 length of segment : 154 DEBUG bbox = [402, 2406, 762, 2688] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007214546203613281 nb_pixel_total : 35434 time to create 1 rle with old method : 0.04240226745605469 length of segment : 403 DEBUG bbox = [378, 1098, 708, 1278] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045299530029296875 nb_pixel_total : 28175 time to create 1 rle with old method : 0.03193521499633789 length of segment : 285 DEBUG bbox = [264, 3030, 492, 3180] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006198883056640625 nb_pixel_total : 20765 time to create 1 rle with old method : 0.024313688278198242 length of segment : 220 DEBUG bbox = [642, 2790, 840, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 21151 time to create 1 rle with old method : 0.028072834014892578 length of segment : 180 DEBUG bbox = [1764, 2820, 1896, 2958] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003345012664794922 nb_pixel_total : 7792 time to create 1 rle with old method : 0.009598016738891602 length of segment : 136 DEBUG bbox = [1854, 1512, 2034, 1752] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 14107 time to create 1 rle with old method : 0.017188072204589844 length of segment : 219 DEBUG bbox = [438, 300, 888, 900] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030019283294677734 nb_pixel_total : 151697 time to create 1 rle with new method : 0.0049326419830322266 length of segment : 487 DEBUG bbox = [612, 2166, 858, 2496] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009510517120361328 nb_pixel_total : 31622 time to create 1 rle with old method : 0.03790616989135742 length of segment : 231 DEBUG bbox = [780, 2118, 1542, 3114] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.009568929672241211 nb_pixel_total : 433013 time to create 1 rle with new method : 0.03443598747253418 length of segment : 772 DEBUG bbox = [234, 792, 486, 996] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007784366607666016 nb_pixel_total : 32137 time to create 1 rle with old method : 0.03647184371948242 length of segment : 236 DEBUG bbox = [1674, 432, 1962, 744] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010521411895751953 nb_pixel_total : 40775 time to create 1 rle with old method : 0.0470585823059082 length of segment : 228 DEBUG bbox = [528, 1152, 936, 1386] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017924308776855469 nb_pixel_total : 60211 time to create 1 rle with old method : 0.0945589542388916 length of segment : 406 DEBUG bbox = [180, 72, 696, 270] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015115737915039062 nb_pixel_total : 51090 time to create 1 rle with old method : 0.060318708419799805 length of segment : 443 DEBUG bbox = [1662, 2826, 2142, 3228] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002323627471923828 nb_pixel_total : 86518 time to create 1 rle with old method : 0.10006451606750488 length of segment : 660 DEBUG bbox = [666, 48, 984, 204] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007672309875488281 nb_pixel_total : 25543 time to create 1 rle with old method : 0.02953338623046875 length of segment : 280 DEBUG bbox = [1722, 1488, 2022, 1812] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016639232635498047 nb_pixel_total : 50329 time to create 1 rle with old method : 0.05732321739196777 length of segment : 272 DEBUG bbox = [342, 954, 546, 1266] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010199546813964844 nb_pixel_total : 32444 time to create 1 rle with old method : 0.0381472110748291 length of segment : 213 DEBUG bbox = [1848, 2736, 2040, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005824565887451172 nb_pixel_total : 12400 time to create 1 rle with old method : 0.014723539352416992 length of segment : 147 DEBUG bbox = [1422, 1740, 1794, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001329183578491211 nb_pixel_total : 40090 time to create 1 rle with old method : 0.04822874069213867 length of segment : 447 DEBUG bbox = [954, 1506, 1368, 1842] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002391815185546875 nb_pixel_total : 85917 time to create 1 rle with old method : 0.10026383399963379 length of segment : 380 DEBUG bbox = [1818, 2340, 2088, 2592] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013244152069091797 nb_pixel_total : 45406 time to create 1 rle with old method : 0.0556645393371582 length of segment : 253 DEBUG bbox = [1662, 666, 1962, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001714468002319336 nb_pixel_total : 42566 time to create 1 rle with old method : 0.05042243003845215 length of segment : 298 DEBUG bbox = [1128, 1842, 1308, 2022] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005419254302978516 nb_pixel_total : 18815 time to create 1 rle with old method : 0.022077322006225586 length of segment : 168 DEBUG bbox = [18, 234, 252, 432] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009474754333496094 nb_pixel_total : 31178 time to create 1 rle with old method : 0.03838610649108887 length of segment : 387 DEBUG bbox = [240, 2712, 462, 2832] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006704330444335938 nb_pixel_total : 12110 time to create 1 rle with old method : 0.014870643615722656 length of segment : 187 DEBUG bbox = [594, 2028, 1002, 2304] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023276805877685547 nb_pixel_total : 63781 time to create 1 rle with old method : 0.07655668258666992 length of segment : 390 DEBUG bbox = [2064, 642, 2154, 756] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025081634521484375 nb_pixel_total : 6672 time to create 1 rle with old method : 0.008074045181274414 length of segment : 92 DEBUG bbox = [1872, 1848, 1962, 1998] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 10545 time to create 1 rle with old method : 0.01274871826171875 length of segment : 89 DEBUG bbox = [1158, 2070, 1488, 2550] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002168416976928711 nb_pixel_total : 84554 time to create 1 rle with old method : 0.12670516967773438 length of segment : 389 time spent for convertir_results : 8.475866317749023 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 77 chid ids of type : 3594 Number RLEs to save : 27040 save missing photos in datou_result : time spend for datou_step_exec : 55.165724754333496 time spend to save output : 1.6355133056640625 total time spend for step 1 : 56.80123805999756 step2:crop_condition Fri Dec 26 14:11:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 77 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 55 About to insert : list_path_to_insert length 55 new photo from crops ! About to upload 55 photos upload in portfolio : 3736932 init cache_photo without model_param we have 55 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766754705_2922956 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037670_0.png', 0, 395, 596, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037671_0.png', 0, 211, 276, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037673_0.png', 0, 760, 419, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037674_0.png', 0, 214, 310, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037676_0.png', 0, 373, 467, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037680_0.png', 0, 227, 195, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037681_0.png', 0, 148, 126, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037683_0.png', 0, 251, 399, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037684_0.png', 0, 381, 444, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037685_0.png', 0, 437, 231, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037686_0.png', 0, 572, 413, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037687_0.png', 0, 259, 176, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037688_0.png', 0, 454, 197, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037689_0.png', 0, 616, 398, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037690_0.png', 0, 392, 380, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037691_0.png', 0, 398, 270, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037692_0.png', 0, 654, 402, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037694_0.png', 0, 254, 194, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037695_0.png', 0, 325, 286, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037696_0.png', 0, 196, 247, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037697_0.png', 0, 496, 1677, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037698_0.png', 0, 280, 563, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037699_0.png', 0, 504, 395, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037701_0.png', 0, 55, 214, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037705_0.png', 0, 143, 204, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037706_0.png', 0, 406, 368, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037707_0.png', 0, 301, 113, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037708_0.png', 0, 381, 389, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037710_0.png', 0, 644, 302, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037711_0.png', 0, 578, 383, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037715_0.png', 0, 530, 206, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037717_0.png', 0, 241, 153, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037718_0.png', 0, 268, 334, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037719_0.png', 0, 151, 279, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037722_0.png', 0, 126, 121, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037723_0.png', 0, 216, 153, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037724_0.png', 0, 595, 406, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037725_0.png', 0, 320, 205, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037726_0.png', 0, 921, 718, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037727_0.png', 0, 193, 236, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037728_0.png', 0, 308, 218, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037730_0.png', 0, 184, 421, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037732_0.png', 0, 143, 279, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037733_0.png', 0, 285, 271, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037734_0.png', 0, 274, 175, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037735_0.png', 0, 134, 145, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037736_0.png', 0, 182, 357, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037739_0.png', 0, 261, 289, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037740_0.png', 0, 166, 168, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037741_0.png', 0, 187, 233, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037742_0.png', 0, 81, 185, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037743_0.png', 0, 252, 375, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037744_0.png', 0, 102, 88, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037745_0.png', 0, 144, 88, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754715), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037746_0.png', 0, 476, 297, 0, 1766754715,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 55 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.530848026275635 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766754720_2922956 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037675_0.png', 0, 142, 199, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037677_0.png', 0, 79, 171, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037679_0.png', 0, 261, 376, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037693_0.png', 0, 433, 232, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037703_0.png', 0, 263, 241, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037704_0.png', 0, 124, 136, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037713_0.png', 0, 166, 217, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037720_0.png', 0, 136, 220, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754722), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037729_0.png', 0, 206, 404, 0, 1766754722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4182987213134766 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766754728_2922956 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037672_0.png', 0, 417, 106, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037678_0.png', 0, 342, 361, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037682_0.png', 0, 256, 737, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037709_0.png', 0, 355, 415, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037712_0.png', 0, 360, 241, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037716_0.png', 0, 555, 701, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037721_0.png', 0, 155, 180, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037731_0.png', 0, 376, 440, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037737_0.png', 0, 317, 378, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754730), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037738_0.png', 0, 237, 251, 0, 1766754730,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.5794289112091064 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766754733_2922956 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754733), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037714_0.png', 0, 744, 389, 0, 1766754733,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9767646789550781 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766754735_2922956 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754735), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037702_0.png', 0, 103, 73, 0, 1766754735,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5517776012420654 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1766754737_2922956 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1766754737), 0.0, 0.0, 14, '', 0, 0, '1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037700_0.png', 0, 355, 215, 0, 1766754737,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5953328609466553 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1401127058, 1401127018, 1401126978, 1401126794, 1401126788, 1401126750, 1401126706, 1401126667] Looping around the photos to save general results len do output : 77 /1401130668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1401130757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127058', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127018', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126978', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126794', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126788', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126750', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126706', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126667', None, None, None, None, None, '4275469') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 239 time used for this insertion : 0.03703927993774414 save_final save missing photos in datou_result : time spend for datou_step_exec : 50.405943155288696 time spend to save output : 0.03988480567932129 total time spend for step 2 : 50.44582796096802 step3:rle_unique_nms_with_priority Fri Dec 26 14:12:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 77 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.13418436050415 time for calcul the mask position with numpy : 0.7906479835510254 nb_pixel_total : 7715986 time to create 1 rle with new method : 1.0068159103393555 time for calcul the mask position with numpy : 0.028635501861572266 nb_pixel_total : 8516 time to create 1 rle with old method : 0.010339736938476562 time for calcul the mask position with numpy : 0.02569866180419922 nb_pixel_total : 129236 time to create 1 rle with old method : 0.15158963203430176 time for calcul the mask position with numpy : 0.02721381187438965 nb_pixel_total : 22082 time to create 1 rle with old method : 0.029409408569335938 time for calcul the mask position with numpy : 0.027289867401123047 nb_pixel_total : 38242 time to create 1 rle with old method : 0.04683375358581543 time for calcul the mask position with numpy : 0.027652978897094727 nb_pixel_total : 186185 time to create 1 rle with new method : 0.7900605201721191 time for calcul the mask position with numpy : 0.023012638092041016 nb_pixel_total : 35974 time to create 1 rle with old method : 0.0402531623840332 time for calcul the mask position with numpy : 0.02494335174560547 nb_pixel_total : 31962 time to create 1 rle with old method : 0.03778553009033203 time for calcul the mask position with numpy : 0.024628400802612305 nb_pixel_total : 126217 time to create 1 rle with old method : 0.1452183723449707 create new chi : 3.3301141262054443 time to delete rle : 0.021449804306030273 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8229 TO DO : save crop sub photo not yet done ! save time : 0.5090594291687012 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.774837255477905 time for calcul the mask position with numpy : 0.6240959167480469 nb_pixel_total : 7828699 time to create 1 rle with new method : 1.0077764987945557 time for calcul the mask position with numpy : 0.02506732940673828 nb_pixel_total : 68918 time to create 1 rle with old method : 0.08069181442260742 time for calcul the mask position with numpy : 0.024335145950317383 nb_pixel_total : 56588 time to create 1 rle with old method : 0.06662583351135254 time for calcul the mask position with numpy : 0.025020599365234375 nb_pixel_total : 1994 time to create 1 rle with old method : 0.002564668655395508 time for calcul the mask position with numpy : 0.025355100631713867 nb_pixel_total : 153178 time to create 1 rle with new method : 0.8340070247650146 time for calcul the mask position with numpy : 0.024729251861572266 nb_pixel_total : 14255 time to create 1 rle with old method : 0.0182192325592041 time for calcul the mask position with numpy : 0.030142545700073242 nb_pixel_total : 22687 time to create 1 rle with old method : 0.02702641487121582 time for calcul the mask position with numpy : 0.02331995964050293 nb_pixel_total : 59479 time to create 1 rle with old method : 0.0682222843170166 time for calcul the mask position with numpy : 0.025676250457763672 nb_pixel_total : 88602 time to create 1 rle with old method : 0.10696721076965332 create new chi : 3.1089560985565186 time to delete rle : 0.0012271404266357422 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8238 TO DO : save crop sub photo not yet done ! save time : 0.5196084976196289 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 8.136898279190063 time for calcul the mask position with numpy : 0.5878796577453613 nb_pixel_total : 6757648 time to create 1 rle with new method : 0.9068148136138916 time for calcul the mask position with numpy : 0.022170066833496094 nb_pixel_total : 5520 time to create 1 rle with old method : 0.0059814453125 time for calcul the mask position with numpy : 0.02247309684753418 nb_pixel_total : 8272 time to create 1 rle with old method : 0.009012222290039062 time for calcul the mask position with numpy : 0.02257370948791504 nb_pixel_total : 41929 time to create 1 rle with old method : 0.047039031982421875 time for calcul the mask position with numpy : 0.023323535919189453 nb_pixel_total : 110407 time to create 1 rle with old method : 0.1232004165649414 time for calcul the mask position with numpy : 0.02371811866760254 nb_pixel_total : 114296 time to create 1 rle with old method : 0.12683892250061035 time for calcul the mask position with numpy : 0.02485370635986328 nb_pixel_total : 367804 time to create 1 rle with new method : 0.8388998508453369 time for calcul the mask position with numpy : 0.02367568016052246 nb_pixel_total : 36340 time to create 1 rle with old method : 0.04120016098022461 time for calcul the mask position with numpy : 0.025011777877807617 nb_pixel_total : 59809 time to create 1 rle with old method : 0.0667564868927002 time for calcul the mask position with numpy : 0.0228271484375 nb_pixel_total : 30713 time to create 1 rle with old method : 0.03347611427307129 time for calcul the mask position with numpy : 0.025352954864501953 nb_pixel_total : 69978 time to create 1 rle with old method : 0.09953784942626953 time for calcul the mask position with numpy : 0.024068117141723633 nb_pixel_total : 179788 time to create 1 rle with new method : 0.6465883255004883 time for calcul the mask position with numpy : 0.025813817977905273 nb_pixel_total : 82655 time to create 1 rle with old method : 0.0942692756652832 time for calcul the mask position with numpy : 0.024003982543945312 nb_pixel_total : 66019 time to create 1 rle with old method : 0.07445287704467773 time for calcul the mask position with numpy : 0.025374889373779297 nb_pixel_total : 153383 time to create 1 rle with new method : 0.8029727935791016 time for calcul the mask position with numpy : 0.025050640106201172 nb_pixel_total : 54796 time to create 1 rle with old method : 0.06286501884460449 time for calcul the mask position with numpy : 0.023249149322509766 nb_pixel_total : 16860 time to create 1 rle with old method : 0.01949167251586914 time for calcul the mask position with numpy : 0.025099754333496094 nb_pixel_total : 138183 time to create 1 rle with old method : 0.15388154983520508 create new chi : 5.26769495010376 time to delete rle : 0.0017566680908203125 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 15938 TO DO : save crop sub photo not yet done ! save time : 0.9391140937805176 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.6739954948425293 time for calcul the mask position with numpy : 0.48484158515930176 nb_pixel_total : 7927407 time to create 1 rle with new method : 0.8008427619934082 time for calcul the mask position with numpy : 0.02352118492126465 nb_pixel_total : 95428 time to create 1 rle with old method : 0.10655713081359863 time for calcul the mask position with numpy : 0.022737741470336914 nb_pixel_total : 9800 time to create 1 rle with old method : 0.01150369644165039 time for calcul the mask position with numpy : 0.02406001091003418 nb_pixel_total : 66784 time to create 1 rle with old method : 0.0740957260131836 time for calcul the mask position with numpy : 0.022817611694335938 nb_pixel_total : 22177 time to create 1 rle with old method : 0.02461552619934082 time for calcul the mask position with numpy : 0.024102449417114258 nb_pixel_total : 105608 time to create 1 rle with old method : 0.14658713340759277 time for calcul the mask position with numpy : 0.03218698501586914 nb_pixel_total : 13918 time to create 1 rle with old method : 0.020717382431030273 time for calcul the mask position with numpy : 0.028601884841918945 nb_pixel_total : 8186 time to create 1 rle with old method : 0.009047985076904297 time for calcul the mask position with numpy : 0.02434253692626953 nb_pixel_total : 45092 time to create 1 rle with old method : 0.05167961120605469 create new chi : 1.971951961517334 time to delete rle : 0.0008997917175292969 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 6597 TO DO : save crop sub photo not yet done ! save time : 0.44000720977783203 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.4452080726623535 time for calcul the mask position with numpy : 0.5027787685394287 nb_pixel_total : 7508200 time to create 1 rle with new method : 0.7828586101531982 time for calcul the mask position with numpy : 0.022252559661865234 nb_pixel_total : 24211 time to create 1 rle with old method : 0.02652454376220703 time for calcul the mask position with numpy : 0.023726701736450195 nb_pixel_total : 257869 time to create 1 rle with new method : 0.782210111618042 time for calcul the mask position with numpy : 0.026189327239990234 nb_pixel_total : 53556 time to create 1 rle with old method : 0.0988314151763916 time for calcul the mask position with numpy : 0.034384965896606445 nb_pixel_total : 235462 time to create 1 rle with new method : 1.213759422302246 time for calcul the mask position with numpy : 0.02398228645324707 nb_pixel_total : 25450 time to create 1 rle with old method : 0.028612375259399414 time for calcul the mask position with numpy : 0.023760557174682617 nb_pixel_total : 61987 time to create 1 rle with old method : 0.06862068176269531 time for calcul the mask position with numpy : 0.023563146591186523 nb_pixel_total : 127665 time to create 1 rle with old method : 0.15161585807800293 create new chi : 3.9187042713165283 time to delete rle : 0.0010924339294433594 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 7260 TO DO : save crop sub photo not yet done ! save time : 0.46871399879455566 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.353745698928833 time for calcul the mask position with numpy : 0.6461975574493408 nb_pixel_total : 8015279 time to create 1 rle with new method : 0.8413865566253662 time for calcul the mask position with numpy : 0.027193546295166016 nb_pixel_total : 151697 time to create 1 rle with new method : 0.6960444450378418 time for calcul the mask position with numpy : 0.02496051788330078 nb_pixel_total : 14107 time to create 1 rle with old method : 0.01639866828918457 time for calcul the mask position with numpy : 0.02339482307434082 nb_pixel_total : 7792 time to create 1 rle with old method : 0.008676528930664062 time for calcul the mask position with numpy : 0.024228811264038086 nb_pixel_total : 21151 time to create 1 rle with old method : 0.023931026458740234 time for calcul the mask position with numpy : 0.024194002151489258 nb_pixel_total : 20765 time to create 1 rle with old method : 0.023640871047973633 time for calcul the mask position with numpy : 0.023619413375854492 nb_pixel_total : 28175 time to create 1 rle with old method : 0.03208661079406738 time for calcul the mask position with numpy : 0.024993419647216797 nb_pixel_total : 35434 time to create 1 rle with old method : 0.040669918060302734 create new chi : 2.5798847675323486 time to delete rle : 0.0008194446563720703 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6020 TO DO : save crop sub photo not yet done ! save time : 0.3965308666229248 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.564700126647949 time for calcul the mask position with numpy : 0.4892735481262207 nb_pixel_total : 7533491 time to create 1 rle with new method : 0.8136146068572998 time for calcul the mask position with numpy : 0.023791074752807617 nb_pixel_total : 25543 time to create 1 rle with old method : 0.029959440231323242 time for calcul the mask position with numpy : 0.025894880294799805 nb_pixel_total : 86518 time to create 1 rle with old method : 0.10064077377319336 time for calcul the mask position with numpy : 0.02486729621887207 nb_pixel_total : 51090 time to create 1 rle with old method : 0.058203697204589844 time for calcul the mask position with numpy : 0.0235748291015625 nb_pixel_total : 60211 time to create 1 rle with old method : 0.06670117378234863 time for calcul the mask position with numpy : 0.02283334732055664 nb_pixel_total : 40775 time to create 1 rle with old method : 0.045907020568847656 time for calcul the mask position with numpy : 0.023680448532104492 nb_pixel_total : 32137 time to create 1 rle with old method : 0.034673452377319336 time for calcul the mask position with numpy : 0.026605844497680664 nb_pixel_total : 433013 time to create 1 rle with new method : 0.7732274532318115 time for calcul the mask position with numpy : 0.025435447692871094 nb_pixel_total : 31622 time to create 1 rle with old method : 0.03693056106567383 create new chi : 2.7199599742889404 time to delete rle : 0.0022377967834472656 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 8672 TO DO : save crop sub photo not yet done ! save time : 0.5522315502166748 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.107685804367065 time for calcul the mask position with numpy : 0.311068058013916 nb_pixel_total : 7757593 time to create 1 rle with new method : 1.5804657936096191 time for calcul the mask position with numpy : 0.025075912475585938 nb_pixel_total : 84554 time to create 1 rle with old method : 0.09875202178955078 time for calcul the mask position with numpy : 0.024106979370117188 nb_pixel_total : 10545 time to create 1 rle with old method : 0.012557744979858398 time for calcul the mask position with numpy : 0.02592301368713379 nb_pixel_total : 6672 time to create 1 rle with old method : 0.008506536483764648 time for calcul the mask position with numpy : 0.02786731719970703 nb_pixel_total : 63781 time to create 1 rle with old method : 0.09132647514343262 time for calcul the mask position with numpy : 0.02462148666381836 nb_pixel_total : 12110 time to create 1 rle with old method : 0.013792991638183594 time for calcul the mask position with numpy : 0.02408576011657715 nb_pixel_total : 31178 time to create 1 rle with old method : 0.035236358642578125 time for calcul the mask position with numpy : 0.02494645118713379 nb_pixel_total : 18815 time to create 1 rle with old method : 0.02187180519104004 time for calcul the mask position with numpy : 0.02494668960571289 nb_pixel_total : 42566 time to create 1 rle with old method : 0.049004316329956055 time for calcul the mask position with numpy : 0.025608062744140625 nb_pixel_total : 45406 time to create 1 rle with old method : 0.05241990089416504 time for calcul the mask position with numpy : 0.02709054946899414 nb_pixel_total : 85917 time to create 1 rle with old method : 0.09966278076171875 time for calcul the mask position with numpy : 0.024342775344848633 nb_pixel_total : 40090 time to create 1 rle with old method : 0.04582977294921875 time for calcul the mask position with numpy : 0.024257421493530273 nb_pixel_total : 12400 time to create 1 rle with old method : 0.013904571533203125 time for calcul the mask position with numpy : 0.02433180809020996 nb_pixel_total : 32444 time to create 1 rle with old method : 0.03804636001586914 time for calcul the mask position with numpy : 0.025792837142944336 nb_pixel_total : 50329 time to create 1 rle with old method : 0.08347201347351074 create new chi : 2.9523913860321045 time to delete rle : 0.001371145248413086 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9584 TO DO : save crop sub photo not yet done ! save time : 0.6318628787994385 map_output_result : {1401127058: (0.0, 'Should be the crop_list due to order', 0), 1401127018: (0.0, 'Should be the crop_list due to order', 0), 1401126978: (0.0, 'Should be the crop_list due to order', 0), 1401126794: (0.0, 'Should be the crop_list due to order', 0), 1401126788: (0.0, 'Should be the crop_list due to order', 0), 1401126750: (0.0, 'Should be the crop_list due to order', 0), 1401126706: (0.0, 'Should be the crop_list due to order', 0), 1401126667: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1401127058, 1401127018, 1401126978, 1401126794, 1401126788, 1401126750, 1401126706, 1401126667] Looping around the photos to save general results len do output : 8 /1401127058.Didn't retrieve data . /1401127018.Didn't retrieve data . /1401126978.Didn't retrieve data . /1401126794.Didn't retrieve data . /1401126788.Didn't retrieve data . /1401126750.Didn't retrieve data . /1401126706.Didn't retrieve data . /1401126667.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127058', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127018', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126978', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126794', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126788', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126750', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126706', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126667', None, None, None, None, None, '4275469') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016364574432373047 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.10216307640076 time spend to save output : 0.016773700714111328 total time spend for step 3 : 68.11893677711487 step4:ventilate_hashtags_in_portfolio Fri Dec 26 14:13:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29717684 get user id for portfolio 29717684 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717684 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','environnement','mal_croppe','autre','pehd','background','pet_clair','pet_fonce','carton','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717684 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','environnement','mal_croppe','autre','pehd','background','pet_clair','pet_fonce','carton','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717684 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','environnement','mal_croppe','autre','pehd','background','pet_clair','pet_fonce','carton','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29718050,29718051,29718052,29718053,29718054,29718055,29718056,29718057,29718058,29718059,29718060?tags=papier,flou,environnement,mal_croppe,autre,pehd,background,pet_clair,pet_fonce,carton,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1401127058, 1401127018, 1401126978, 1401126794, 1401126788, 1401126750, 1401126706, 1401126667] Looping around the photos to save general results len do output : 1 /29717684. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127058', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127018', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126978', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126794', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126788', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126750', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126706', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126667', None, None, None, None, None, '4275469') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016986608505249023 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9530906677246094 time spend to save output : 0.017313480377197266 total time spend for step 4 : 1.9704041481018066 step5:final Fri Dec 26 14:13:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1401127058: ('0.08003738968460646',), 1401127018: ('0.08003738968460646',), 1401126978: ('0.08003738968460646',), 1401126794: ('0.08003738968460646',), 1401126788: ('0.08003738968460646',), 1401126750: ('0.08003738968460646',), 1401126706: ('0.08003738968460646',), 1401126667: ('0.08003738968460646',)} new output for save of step final : {1401127058: ('0.08003738968460646',), 1401127018: ('0.08003738968460646',), 1401126978: ('0.08003738968460646',), 1401126794: ('0.08003738968460646',), 1401126788: ('0.08003738968460646',), 1401126750: ('0.08003738968460646',), 1401126706: ('0.08003738968460646',), 1401126667: ('0.08003738968460646',)} [1401127058, 1401127018, 1401126978, 1401126794, 1401126788, 1401126750, 1401126706, 1401126667] Looping around the photos to save general results len do output : 8 /1401127058.Didn't retrieve data . /1401127018.Didn't retrieve data . /1401126978.Didn't retrieve data . /1401126794.Didn't retrieve data . /1401126788.Didn't retrieve data . /1401126750.Didn't retrieve data . /1401126706.Didn't retrieve data . /1401126667.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127058', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127018', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126978', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126794', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126788', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126750', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126706', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126667', None, None, None, None, None, '4275469') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015441179275512695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16539478302001953 time spend to save output : 0.015742778778076172 total time spend for step 5 : 0.1811375617980957 step6:blur_detection Fri Dec 26 14:13:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4.jpg resize: (2160, 3840) 1401127058 -6.886408294045743 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27.jpg resize: (2160, 3840) 1401127018 -6.778117437717345 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7.jpg resize: (2160, 3840) 1401126978 -6.7821802402293505 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0.jpg resize: (2160, 3840) 1401126794 -6.98046636596874 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba.jpg resize: (2160, 3840) 1401126788 -6.870876606056771 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4.jpg resize: (2160, 3840) 1401126750 -6.833395673380268 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694.jpg resize: (2160, 3840) 1401126706 -6.833204879343478 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333.jpg resize: (2160, 3840) 1401126667 -5.9749418604435025 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037670_0.png resize: (596, 395) 1401130668 -1.3935532097549865 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037671_0.png resize: (276, 211) 1401130669 -2.978969382809149 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037673_0.png resize: (419, 760) 1401130670 -3.241044178605179 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037674_0.png resize: (310, 214) 1401130671 -4.779365145576379 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037676_0.png resize: (467, 373) 1401130672 -4.322511815023247 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037680_0.png resize: (195, 227) 1401130673 -3.4600836547764664 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037681_0.png resize: (126, 148) 1401130674 -3.8748874806156857 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037683_0.png resize: (399, 251) 1401130675 -4.180895693820791 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037684_0.png resize: (444, 381) 1401130676 -2.472047920443478 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037685_0.png resize: (231, 437) 1401130677 -3.3205652506072125 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037686_0.png resize: (413, 572) 1401130678 -4.785607744055976 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037687_0.png resize: (176, 259) 1401130679 -2.6112459929096414 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037688_0.png resize: (197, 454) 1401130680 -0.8524036084253267 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037689_0.png resize: (398, 616) 1401130681 -3.4757609185292333 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037690_0.png resize: (380, 392) 1401130682 -4.088509391402352 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037691_0.png resize: (270, 398) 1401130683 -4.7760330328254295 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037692_0.png resize: (402, 654) 1401130684 -3.449871614066146 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037694_0.png resize: (194, 254) 1401130685 -2.874204185268274 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037695_0.png resize: (286, 325) 1401130686 -3.737975672518742 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037696_0.png resize: (247, 196) 1401130687 -3.4224189741458733 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037697_0.png resize: (1677, 496) 1401130688 -2.7380400725804797 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037698_0.png resize: (563, 280) 1401130689 -3.0270498851897387 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037699_0.png resize: (395, 504) 1401130690 -3.4826479846866603 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037701_0.png resize: (214, 55) 1401130691 -3.2978414432091006 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037705_0.png resize: (204, 143) 1401130692 -2.4345356197955836 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037706_0.png resize: (368, 406) 1401130693 -1.3907113851226622 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037707_0.png resize: (113, 301) 1401130694 -3.8148113788106945 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037708_0.png resize: (389, 381) 1401130695 -4.365865931633082 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037710_0.png resize: (302, 644) 1401130696 -4.214094612618846 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037711_0.png resize: (383, 578) 1401130697 -4.484740581391749 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037715_0.png resize: (206, 530) 1401130698 -3.9070948471590876 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037717_0.png resize: (153, 241) 1401130699 -1.0601755611035082 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037718_0.png resize: (334, 268) 1401130700 -0.7949556960778823 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037719_0.png resize: (279, 151) 1401130701 -2.174830659963006 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037722_0.png resize: (121, 126) 1401130702 -2.5522144980273724 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037723_0.png resize: (153, 216) 1401130703 -3.711606525588523 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037724_0.png resize: (406, 595) 1401130704 -2.783322918269924 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037725_0.png resize: (205, 320) 1401130705 -1.0433281757750856 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037726_0.png resize: (718, 921) 1401130706 -1.954930213816205 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037727_0.png resize: (236, 193) 1401130707 -1.4789987745501953 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037728_0.png resize: (218, 308) 1401130708 -4.457886057546303 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037730_0.png resize: (421, 184) 1401130709 -3.4855911327967655 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037732_0.png resize: (279, 143) 1401130710 -1.939171845031264 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037733_0.png resize: (271, 285) 1401130711 -1.8310409744101797 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037734_0.png resize: (175, 274) 1401130712 -3.656055095556068 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037735_0.png resize: (145, 134) 1401130713 -3.0471694873332744 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037736_0.png resize: (357, 182) 1401130714 -4.37904461213279 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037739_0.png resize: (289, 261) 1401130715 -3.6125779949634524 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037740_0.png resize: (168, 166) 1401130716 -3.62426999269741 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037741_0.png resize: (233, 187) 1401130717 -3.6450562585143533 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037742_0.png resize: (185, 81) 1401130718 -2.8307831467104494 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037743_0.png resize: (375, 252) 1401130719 -2.828051057321618 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037744_0.png resize: (88, 102) 1401130720 -3.386585275345693 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037745_0.png resize: (88, 144) 1401130721 -3.688481157322584 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037746_0.png resize: (297, 476) 1401130722 -3.9961214649412256 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037675_0.png resize: (199, 142) 1401130729 -3.834544917229894 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037677_0.png resize: (171, 79) 1401130730 -3.4117686845093154 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037679_0.png resize: (376, 261) 1401130731 -4.1666344709676855 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037693_0.png resize: (232, 433) 1401130732 -3.054870046867704 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037703_0.png resize: (241, 263) 1401130733 -4.659317859761392 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037704_0.png resize: (136, 124) 1401130734 -3.9882658384394727 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037713_0.png resize: (217, 166) 1401130735 -2.886886390203876 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037720_0.png resize: (220, 136) 1401130736 -3.208617010950867 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037729_0.png resize: (404, 206) 1401130737 -3.3044070072518696 treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037672_0.png resize: (106, 417) 1401130742 -4.89626905974619 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037678_0.png resize: (361, 342) 1401130743 -4.122609758691606 treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037682_0.png resize: (737, 256) 1401130744 -3.5954255913858306 treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037709_0.png resize: (415, 355) 1401130745 -4.538932075107643 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037712_0.png resize: (241, 360) 1401130746 -4.255737569028759 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037716_0.png resize: (701, 555) 1401130747 -2.3070522005375578 treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037721_0.png resize: (180, 155) 1401130748 -4.3242106746973095 treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037731_0.png resize: (440, 376) 1401130749 -3.8057374770156325 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037737_0.png resize: (378, 317) 1401130750 -4.2899418156700495 treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037738_0.png resize: (251, 237) 1401130751 -3.9742633977187345 treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037714_0.png resize: (389, 744) 1401130754 -1.5859968945893415 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037702_0.png resize: (73, 103) 1401130755 -1.4570144920598513 treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037700_0.png resize: (215, 355) 1401130757 -3.4165945745138564 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 85 time used for this insertion : 0.017505884170532227 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 85 time used for this insertion : 0.017830610275268555 save missing photos in datou_result : time spend for datou_step_exec : 32.970009088516235 time spend to save output : 0.041603803634643555 total time spend for step 6 : 33.01161289215088 step7:brightness Fri Dec 26 14:14:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4.jpg treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27.jpg treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7.jpg treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0.jpg treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba.jpg treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4.jpg treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694.jpg treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333.jpg treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037670_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037671_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037673_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037674_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037676_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037680_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037681_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037683_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037684_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037685_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037686_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037687_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037688_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037689_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037690_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037691_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037692_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037694_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037695_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037696_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037697_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037698_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037699_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037701_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037705_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037706_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037707_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037708_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037710_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037711_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037715_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037717_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037718_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037719_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037722_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037723_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037724_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037725_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037726_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037727_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037728_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037730_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037732_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037733_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037734_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037735_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037736_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037739_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037740_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037741_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037742_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037743_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037744_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037745_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037746_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037675_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037677_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037679_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037693_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037703_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037704_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037713_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037720_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037729_0.png treat image : temp/1766754628_2922956_1401127058_9867d81c787e98092814db67910475a4_rle_crop_4082037672_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037678_0.png treat image : temp/1766754628_2922956_1401127018_6868ea2cccd3ffd3dacea78dafefef27_rle_crop_4082037682_0.png treat image : temp/1766754628_2922956_1401126794_d1ed961fc9a62c1afc69ffc63f8e87a0_rle_crop_4082037709_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037712_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037716_0.png treat image : temp/1766754628_2922956_1401126750_d32c63656ce8f314aab165a51f0b4cd4_rle_crop_4082037721_0.png treat image : temp/1766754628_2922956_1401126706_b01c9d5ef26054f34a002c4c05b4d694_rle_crop_4082037731_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037737_0.png treat image : temp/1766754628_2922956_1401126667_641fba334228e98850bdaf1689985333_rle_crop_4082037738_0.png treat image : temp/1766754628_2922956_1401126788_4623342444b2e1094b77051cdabbbfba_rle_crop_4082037714_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037702_0.png treat image : temp/1766754628_2922956_1401126978_a53f5b3a4f471003891354548e8a50e7_rle_crop_4082037700_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 85 time used for this insertion : 0.01914215087890625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 85 time used for this insertion : 0.021010398864746094 save missing photos in datou_result : time spend for datou_step_exec : 9.387154340744019 time spend to save output : 0.04589533805847168 total time spend for step 7 : 9.43304967880249 step8:velours_tree Fri Dec 26 14:14:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08182525634765625 time spend to save output : 3.981590270996094e-05 total time spend for step 8 : 0.08186507225036621 step9:send_mail_cod Fri Dec 26 14:14:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29717684_26-12-2025_14_14_10.pdf 29718050 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297180501766754850 29718051 imagette297180511766754852 29718053 imagette297180531766754852 29718054 change filename to text .imagette297180541766754852 29718055 change filename to text .imagette297180551766754852 29718056 imagette297180561766754852 29718057 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297180571766754852 29718058 change filename to text .imagette297180581766754853 29718059 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette297180591766754853 29718060 imagette297180601766754854 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29717684 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29718050,29718051,29718052,29718053,29718054,29718055,29718056,29718057,29718058,29718059,29718060?tags=papier,flou,environnement,mal_croppe,autre,pehd,background,pet_clair,pet_fonce,carton,metal your option no_mail is active, we will not send the real mail to your client args[1401127058] : ((1401127058, -6.886408294045743, 492609224), (1401127058, 1.6811726481419023, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401127018] : ((1401127018, -6.778117437717345, 492609224), (1401127018, 1.4916014299310398, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401126978] : ((1401126978, -6.7821802402293505, 492609224), (1401126978, 1.1420153521579468, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401126794] : ((1401126794, -6.98046636596874, 492609224), (1401126794, 1.2484734309657257, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401126788] : ((1401126788, -6.870876606056771, 492609224), (1401126788, 1.5895726452054197, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401126750] : ((1401126750, -6.833395673380268, 492609224), (1401126750, 1.2676534846959215, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401126706] : ((1401126706, -6.833204879343478, 492609224), (1401126706, 2.2031353743703943, 492649241), '0.08003738968460646') We are sending mail with results at report@fotonower.com args[1401126667] : ((1401126667, -5.9749418604435025, 492609224), (1401126667, 0.6763480669117325, 2107752395), '0.08003738968460646') We are sending mail with results at report@fotonower.com refus_total : 0.08003738968460646 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29717684 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717684_26-12-2025_14_14_10.pdf results_Auto_P29717684_26-12-2025_14_14_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717684_26-12-2025_14_14_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29717684','results_Auto_P29717684_26-12-2025_14_14_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717684_26-12-2025_14_14_10.pdf','pdf','','0.57','0.08003738968460646') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1401127058, 1401127018, 1401126978, 1401126794, 1401126788, 1401126750, 1401126706, 1401126667] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127058', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127018', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126978', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126794', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126788', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126750', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126706', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126667', None, None, None, None, None, '4275469') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014187812805175781 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.1380579471588135 time spend to save output : 0.014353275299072266 total time spend for step 9 : 6.152411222457886 step10:split_time_score Fri Dec 26 14:14:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26122025 29717684 Nombre de photos uploadées : 8 / 23040 (0%) 26122025 29717684 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 26122025 29717684 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004343986511230469 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2396988868713379 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.01938292115921462 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29708948_26-12-2025_07_09_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29708948 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29708948 AND mptpi.`type`=3726 To do Qualite : 0.06187620953665258 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29708950_26-12-2025_07_05_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29708950 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29708950 AND mptpi.`type`=3726 To do Qualite : 0.026835068575215205 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29716804_26-12-2025_12_38_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29716804 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29716804 AND mptpi.`type`=3726 To do Qualite : 0.04893544432093284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717683_26-12-2025_14_09_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29717683 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717683 AND mptpi.`type`=3726 To do Qualite : 0.08003738968460646 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717684_26-12-2025_14_14_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29717684 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717684 AND mptpi.`type`=3594 To do Qualite : 0.050825570203407666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29717711_26-12-2025_14_05_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29717711 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29717711 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26122025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1401127058, 1401127018, 1401126978, 1401126794, 1401126788, 1401126750, 1401126706, 1401126667] Looping around the photos to save general results len do output : 1 /29717684Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127058', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401127018', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126978', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126794', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126788', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126750', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126706', None, None, None, None, None, '4275469') ('3318', None, None, None, None, None, None, None, '4275469') ('3318', '29717684', '1401126667', None, None, None, None, None, '4275469') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.016185283660888672 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8771605491638184 time spend to save output : 0.01636648178100586 total time spend for step 10 : 0.8935270309448242 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 103.02user 96.31system 3:52.82elapsed 85%CPU (0avgtext+0avgdata 3961048maxresident)k 2163872inputs+98640outputs (7924major+8790479minor)pagefaults 0swaps