python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3062092 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3833565'] with mtr_portfolio_ids : ['27485662'] and first list_photo_ids : [] new path : /proc/3062092/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 2.894599437713623 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 3 11:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5066 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-03 11:40:35.568615: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-03 11:40:35.604504: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-10-03 11:40:35.607428: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4188000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-03 11:40:35.607483: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-03 11:40:35.612490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-03 11:40:35.763893: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x24b6e6b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-03 11:40:35.763947: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-03 11:40:35.764983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-03 11:40:35.765444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 11:40:35.768415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 11:40:35.784942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-03 11:40:35.785365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-03 11:40:35.813890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-03 11:40:35.818583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-03 11:40:35.878533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 11:40:35.880120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-03 11:40:35.880525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 11:40:35.881462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-03 11:40:35.881487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-03 11:40:35.881502: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-03 11:40:35.883381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4614 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-03 11:40:36.394352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-03 11:40:36.394447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 11:40:36.394475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 11:40:36.394501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-03 11:40:36.394525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-03 11:40:36.394550: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-03 11:40:36.394574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-03 11:40:36.394599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 11:40:36.396153: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-03 11:40:36.397976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-03 11:40:36.398031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 11:40:36.398047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 11:40:36.398062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-03 11:40:36.398075: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-03 11:40:36.398090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-03 11:40:36.398104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-03 11:40:36.398118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 11:40:36.399061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-03 11:40:36.399090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-03 11:40:36.399100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-03 11:40:36.399107: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-03 11:40:36.400149: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4614 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-03 11:40:47.371947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 11:40:47.617860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 11:40:49.787584: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:49.788457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:49.789248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.614323: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-03 11:40:50.687815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.687921: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.689087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.689122: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.695883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.695912: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.696685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.696706: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.719786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.719880: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.719900: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-03 11:40:50.721108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.721140: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.722259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.722287: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.729382: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.729402: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.729973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.729987: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.730571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.730585: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 11:40:50.731155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.739000: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.739579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.769268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.769895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.770478: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.771073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.775222: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.775852: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.776481: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.777108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.778143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.788265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.788853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.797904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.798506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.799110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.799710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.800328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 11:40:50.800914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 3062724 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3873 tf kernel not reseted sub process len(results) : 14 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 14 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5066 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0026721954345703125 nb_pixel_total : 70029 time to create 1 rle with old method : 0.09269237518310547 length of segment : 298 time for calcul the mask position with numpy : 0.0020318031311035156 nb_pixel_total : 60205 time to create 1 rle with old method : 0.08265542984008789 length of segment : 386 time for calcul the mask position with numpy : 0.002711057662963867 nb_pixel_total : 96631 time to create 1 rle with old method : 0.12336134910583496 length of segment : 372 time for calcul the mask position with numpy : 0.00031566619873046875 nb_pixel_total : 12191 time to create 1 rle with old method : 0.016263961791992188 length of segment : 83 time for calcul the mask position with numpy : 0.0005440711975097656 nb_pixel_total : 23588 time to create 1 rle with old method : 0.03585171699523926 length of segment : 208 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 20100 time to create 1 rle with old method : 0.021956682205200195 length of segment : 114 time for calcul the mask position with numpy : 0.0009374618530273438 nb_pixel_total : 50219 time to create 1 rle with old method : 0.054846763610839844 length of segment : 353 time for calcul the mask position with numpy : 0.0015590190887451172 nb_pixel_total : 45350 time to create 1 rle with old method : 0.06338620185852051 length of segment : 631 time for calcul the mask position with numpy : 0.0012993812561035156 nb_pixel_total : 33475 time to create 1 rle with old method : 0.05756521224975586 length of segment : 382 time for calcul the mask position with numpy : 0.0036115646362304688 nb_pixel_total : 107269 time to create 1 rle with old method : 0.1497499942779541 length of segment : 489 time for calcul the mask position with numpy : 0.006037473678588867 nb_pixel_total : 133703 time to create 1 rle with old method : 0.1956169605255127 length of segment : 413 time for calcul the mask position with numpy : 0.0013985633850097656 nb_pixel_total : 63476 time to create 1 rle with old method : 0.0881655216217041 length of segment : 330 time for calcul the mask position with numpy : 0.0017704963684082031 nb_pixel_total : 59881 time to create 1 rle with old method : 0.08890748023986816 length of segment : 349 time for calcul the mask position with numpy : 0.0006592273712158203 nb_pixel_total : 21316 time to create 1 rle with old method : 0.030867338180541992 length of segment : 284 time for calcul the mask position with numpy : 0.00044798851013183594 nb_pixel_total : 15731 time to create 1 rle with old method : 0.02244114875793457 length of segment : 187 time for calcul the mask position with numpy : 0.002004384994506836 nb_pixel_total : 63886 time to create 1 rle with old method : 0.09338116645812988 length of segment : 698 time for calcul the mask position with numpy : 0.0011181831359863281 nb_pixel_total : 41313 time to create 1 rle with old method : 0.07051467895507812 length of segment : 388 time for calcul the mask position with numpy : 0.0009038448333740234 nb_pixel_total : 33827 time to create 1 rle with old method : 0.04794478416442871 length of segment : 318 time for calcul the mask position with numpy : 0.0007166862487792969 nb_pixel_total : 29768 time to create 1 rle with old method : 0.03456258773803711 length of segment : 204 time for calcul the mask position with numpy : 0.0028562545776367188 nb_pixel_total : 111683 time to create 1 rle with old method : 0.13692355155944824 length of segment : 519 time for calcul the mask position with numpy : 0.001730203628540039 nb_pixel_total : 106487 time to create 1 rle with old method : 0.12462377548217773 length of segment : 476 time for calcul the mask position with numpy : 0.0017251968383789062 nb_pixel_total : 70766 time to create 1 rle with old method : 0.07694244384765625 length of segment : 263 time for calcul the mask position with numpy : 0.0011494159698486328 nb_pixel_total : 38355 time to create 1 rle with old method : 0.0413975715637207 length of segment : 284 time for calcul the mask position with numpy : 0.0004508495330810547 nb_pixel_total : 26075 time to create 1 rle with old method : 0.033408164978027344 length of segment : 167 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 13073 time to create 1 rle with old method : 0.015884876251220703 length of segment : 180 time for calcul the mask position with numpy : 0.0007600784301757812 nb_pixel_total : 33652 time to create 1 rle with old method : 0.03753161430358887 length of segment : 155 time for calcul the mask position with numpy : 0.005389690399169922 nb_pixel_total : 186178 time to create 1 rle with new method : 0.007450580596923828 length of segment : 522 time for calcul the mask position with numpy : 0.0007665157318115234 nb_pixel_total : 18420 time to create 1 rle with old method : 0.02106332778930664 length of segment : 202 time for calcul the mask position with numpy : 0.0015115737915039062 nb_pixel_total : 71967 time to create 1 rle with old method : 0.1268758773803711 length of segment : 316 time for calcul the mask position with numpy : 0.002244710922241211 nb_pixel_total : 168572 time to create 1 rle with new method : 0.007662534713745117 length of segment : 344 time for calcul the mask position with numpy : 0.0006229877471923828 nb_pixel_total : 16646 time to create 1 rle with old method : 0.019402265548706055 length of segment : 209 time for calcul the mask position with numpy : 0.0001938343048095703 nb_pixel_total : 4805 time to create 1 rle with old method : 0.0053937435150146484 length of segment : 150 time for calcul the mask position with numpy : 0.0034363269805908203 nb_pixel_total : 102858 time to create 1 rle with old method : 0.12607717514038086 length of segment : 491 time for calcul the mask position with numpy : 0.0015349388122558594 nb_pixel_total : 45324 time to create 1 rle with old method : 0.054015159606933594 length of segment : 289 time for calcul the mask position with numpy : 0.001241922378540039 nb_pixel_total : 39735 time to create 1 rle with old method : 0.04784965515136719 length of segment : 242 time for calcul the mask position with numpy : 0.0007622241973876953 nb_pixel_total : 28144 time to create 1 rle with old method : 0.03160858154296875 length of segment : 168 time for calcul the mask position with numpy : 0.0009555816650390625 nb_pixel_total : 32612 time to create 1 rle with old method : 0.04206275939941406 length of segment : 220 time for calcul the mask position with numpy : 0.006837606430053711 nb_pixel_total : 183067 time to create 1 rle with new method : 0.014740705490112305 length of segment : 552 time for calcul the mask position with numpy : 0.0025336742401123047 nb_pixel_total : 81627 time to create 1 rle with old method : 0.09379053115844727 length of segment : 381 time for calcul the mask position with numpy : 0.0005903244018554688 nb_pixel_total : 11446 time to create 1 rle with old method : 0.013207197189331055 length of segment : 170 time for calcul the mask position with numpy : 0.0014529228210449219 nb_pixel_total : 43826 time to create 1 rle with old method : 0.05068397521972656 length of segment : 271 time for calcul the mask position with numpy : 0.002517223358154297 nb_pixel_total : 75734 time to create 1 rle with old method : 0.10444045066833496 length of segment : 301 time for calcul the mask position with numpy : 0.000888824462890625 nb_pixel_total : 18861 time to create 1 rle with old method : 0.02196216583251953 length of segment : 235 time for calcul the mask position with numpy : 0.0017478466033935547 nb_pixel_total : 46096 time to create 1 rle with old method : 0.053511619567871094 length of segment : 277 time for calcul the mask position with numpy : 0.0017294883728027344 nb_pixel_total : 32071 time to create 1 rle with old method : 0.03696632385253906 length of segment : 272 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 25756 time to create 1 rle with old method : 0.02966022491455078 length of segment : 236 time for calcul the mask position with numpy : 0.0010957717895507812 nb_pixel_total : 39386 time to create 1 rle with old method : 0.04460287094116211 length of segment : 272 time for calcul the mask position with numpy : 0.00038051605224609375 nb_pixel_total : 6732 time to create 1 rle with old method : 0.007960319519042969 length of segment : 115 time for calcul the mask position with numpy : 0.0009927749633789062 nb_pixel_total : 34624 time to create 1 rle with old method : 0.04282116889953613 length of segment : 147 time for calcul the mask position with numpy : 0.0004940032958984375 nb_pixel_total : 9899 time to create 1 rle with old method : 0.011461257934570312 length of segment : 120 time for calcul the mask position with numpy : 0.0010933876037597656 nb_pixel_total : 29052 time to create 1 rle with old method : 0.03326582908630371 length of segment : 203 time for calcul the mask position with numpy : 0.0013113021850585938 nb_pixel_total : 37631 time to create 1 rle with old method : 0.04352164268493652 length of segment : 260 time for calcul the mask position with numpy : 0.003153562545776367 nb_pixel_total : 108803 time to create 1 rle with old method : 0.11872124671936035 length of segment : 407 time for calcul the mask position with numpy : 0.0032176971435546875 nb_pixel_total : 142187 time to create 1 rle with old method : 0.14851737022399902 length of segment : 526 time for calcul the mask position with numpy : 0.0026290416717529297 nb_pixel_total : 98856 time to create 1 rle with old method : 0.11077213287353516 length of segment : 541 time for calcul the mask position with numpy : 0.0009887218475341797 nb_pixel_total : 28806 time to create 1 rle with old method : 0.034493207931518555 length of segment : 219 time for calcul the mask position with numpy : 0.001074075698852539 nb_pixel_total : 31389 time to create 1 rle with old method : 0.03608512878417969 length of segment : 209 time for calcul the mask position with numpy : 0.0054166316986083984 nb_pixel_total : 218878 time to create 1 rle with new method : 0.01026296615600586 length of segment : 344 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 6148 time to create 1 rle with old method : 0.007418394088745117 length of segment : 99 time for calcul the mask position with numpy : 0.0018868446350097656 nb_pixel_total : 49777 time to create 1 rle with old method : 0.05543971061706543 length of segment : 266 time for calcul the mask position with numpy : 0.0017642974853515625 nb_pixel_total : 61739 time to create 1 rle with old method : 0.06774258613586426 length of segment : 382 time for calcul the mask position with numpy : 0.002338886260986328 nb_pixel_total : 57567 time to create 1 rle with old method : 0.08227157592773438 length of segment : 355 time for calcul the mask position with numpy : 0.0014100074768066406 nb_pixel_total : 41418 time to create 1 rle with old method : 0.04750990867614746 length of segment : 273 time for calcul the mask position with numpy : 0.001711130142211914 nb_pixel_total : 39265 time to create 1 rle with old method : 0.04537081718444824 length of segment : 363 time for calcul the mask position with numpy : 0.0007255077362060547 nb_pixel_total : 18965 time to create 1 rle with old method : 0.022327899932861328 length of segment : 221 time for calcul the mask position with numpy : 0.0026564598083496094 nb_pixel_total : 63838 time to create 1 rle with old method : 0.07757568359375 length of segment : 270 time for calcul the mask position with numpy : 0.0031630992889404297 nb_pixel_total : 57901 time to create 1 rle with old method : 0.06725096702575684 length of segment : 513 time for calcul the mask position with numpy : 0.001806497573852539 nb_pixel_total : 45492 time to create 1 rle with old method : 0.06582140922546387 length of segment : 287 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 11781 time to create 1 rle with old method : 0.014108657836914062 length of segment : 88 time for calcul the mask position with numpy : 0.0010561943054199219 nb_pixel_total : 33916 time to create 1 rle with old method : 0.043665409088134766 length of segment : 297 time for calcul the mask position with numpy : 0.0007333755493164062 nb_pixel_total : 14359 time to create 1 rle with old method : 0.019407272338867188 length of segment : 181 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 20978 time to create 1 rle with old method : 0.024448633193969727 length of segment : 188 time for calcul the mask position with numpy : 0.0006270408630371094 nb_pixel_total : 19247 time to create 1 rle with old method : 0.022652864456176758 length of segment : 203 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 18429 time to create 1 rle with old method : 0.023117542266845703 length of segment : 170 time for calcul the mask position with numpy : 0.001394033432006836 nb_pixel_total : 60639 time to create 1 rle with old method : 0.06603312492370605 length of segment : 279 time for calcul the mask position with numpy : 0.0011172294616699219 nb_pixel_total : 39511 time to create 1 rle with old method : 0.04293060302734375 length of segment : 271 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 17666 time to create 1 rle with old method : 0.0194857120513916 length of segment : 91 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 17199 time to create 1 rle with old method : 0.019420146942138672 length of segment : 195 time for calcul the mask position with numpy : 0.0008382797241210938 nb_pixel_total : 30661 time to create 1 rle with old method : 0.03296852111816406 length of segment : 259 time for calcul the mask position with numpy : 0.003220081329345703 nb_pixel_total : 116205 time to create 1 rle with old method : 0.12488317489624023 length of segment : 569 time for calcul the mask position with numpy : 0.0018992424011230469 nb_pixel_total : 52866 time to create 1 rle with old method : 0.0665283203125 length of segment : 351 time for calcul the mask position with numpy : 0.0018963813781738281 nb_pixel_total : 47324 time to create 1 rle with old method : 0.05599689483642578 length of segment : 272 time for calcul the mask position with numpy : 0.0016112327575683594 nb_pixel_total : 47270 time to create 1 rle with old method : 0.052083730697631836 length of segment : 383 time for calcul the mask position with numpy : 0.004120826721191406 nb_pixel_total : 166773 time to create 1 rle with new method : 0.008634805679321289 length of segment : 591 time for calcul the mask position with numpy : 0.0011992454528808594 nb_pixel_total : 46566 time to create 1 rle with old method : 0.053702592849731445 length of segment : 241 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 37708 time to create 1 rle with old method : 0.04252743721008301 length of segment : 300 time for calcul the mask position with numpy : 0.0023126602172851562 nb_pixel_total : 98894 time to create 1 rle with old method : 0.11023330688476562 length of segment : 491 time for calcul the mask position with numpy : 0.002038717269897461 nb_pixel_total : 94902 time to create 1 rle with old method : 0.10521864891052246 length of segment : 411 time for calcul the mask position with numpy : 0.003406047821044922 nb_pixel_total : 161023 time to create 1 rle with new method : 0.009747028350830078 length of segment : 423 time for calcul the mask position with numpy : 0.0016562938690185547 nb_pixel_total : 56470 time to create 1 rle with old method : 0.06502938270568848 length of segment : 259 time for calcul the mask position with numpy : 0.0007507801055908203 nb_pixel_total : 24168 time to create 1 rle with old method : 0.02721881866455078 length of segment : 200 time for calcul the mask position with numpy : 0.0009415149688720703 nb_pixel_total : 37678 time to create 1 rle with old method : 0.04107666015625 length of segment : 270 time for calcul the mask position with numpy : 0.0008690357208251953 nb_pixel_total : 12028 time to create 1 rle with old method : 0.013434171676635742 length of segment : 250 time for calcul the mask position with numpy : 0.0010204315185546875 nb_pixel_total : 28341 time to create 1 rle with old method : 0.03133964538574219 length of segment : 251 time for calcul the mask position with numpy : 0.0017600059509277344 nb_pixel_total : 81073 time to create 1 rle with old method : 0.09586453437805176 length of segment : 331 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 25194 time to create 1 rle with old method : 0.02814936637878418 length of segment : 232 time for calcul the mask position with numpy : 0.0008542537689208984 nb_pixel_total : 34322 time to create 1 rle with old method : 0.03840756416320801 length of segment : 231 time for calcul the mask position with numpy : 0.0016989707946777344 nb_pixel_total : 74362 time to create 1 rle with old method : 0.0805206298828125 length of segment : 327 time for calcul the mask position with numpy : 0.0006115436553955078 nb_pixel_total : 23303 time to create 1 rle with old method : 0.025629758834838867 length of segment : 164 time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 32559 time to create 1 rle with old method : 0.03520774841308594 length of segment : 317 time for calcul the mask position with numpy : 0.0037360191345214844 nb_pixel_total : 176944 time to create 1 rle with new method : 0.007947206497192383 length of segment : 635 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 6991 time to create 1 rle with old method : 0.011577367782592773 length of segment : 76 time for calcul the mask position with numpy : 0.0012469291687011719 nb_pixel_total : 43852 time to create 1 rle with old method : 0.054428815841674805 length of segment : 200 time for calcul the mask position with numpy : 0.0004966259002685547 nb_pixel_total : 22166 time to create 1 rle with old method : 0.02492523193359375 length of segment : 159 time for calcul the mask position with numpy : 0.0002887248992919922 nb_pixel_total : 10223 time to create 1 rle with old method : 0.011749267578125 length of segment : 103 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 7589 time to create 1 rle with old method : 0.008895635604858398 length of segment : 101 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 16532 time to create 1 rle with old method : 0.01880168914794922 length of segment : 208 time for calcul the mask position with numpy : 0.0025942325592041016 nb_pixel_total : 111033 time to create 1 rle with old method : 0.12288379669189453 length of segment : 184 time for calcul the mask position with numpy : 0.0008563995361328125 nb_pixel_total : 45510 time to create 1 rle with old method : 0.05153250694274902 length of segment : 207 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 12560 time to create 1 rle with old method : 0.014171361923217773 length of segment : 108 time for calcul the mask position with numpy : 0.0006911754608154297 nb_pixel_total : 21906 time to create 1 rle with old method : 0.024844884872436523 length of segment : 272 time for calcul the mask position with numpy : 0.0016412734985351562 nb_pixel_total : 74194 time to create 1 rle with old method : 0.0827474594116211 length of segment : 542 time for calcul the mask position with numpy : 0.002020120620727539 nb_pixel_total : 95866 time to create 1 rle with old method : 0.10703253746032715 length of segment : 355 time for calcul the mask position with numpy : 0.0008342266082763672 nb_pixel_total : 27352 time to create 1 rle with old method : 0.02974700927734375 length of segment : 293 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 6264 time to create 1 rle with old method : 0.00718998908996582 length of segment : 91 time for calcul the mask position with numpy : 0.00044918060302734375 nb_pixel_total : 14273 time to create 1 rle with old method : 0.01590752601623535 length of segment : 153 time for calcul the mask position with numpy : 0.0007598400115966797 nb_pixel_total : 21642 time to create 1 rle with old method : 0.02329230308532715 length of segment : 308 time for calcul the mask position with numpy : 0.0030019283294677734 nb_pixel_total : 122202 time to create 1 rle with old method : 0.13681817054748535 length of segment : 660 time spent for convertir_results : 12.332885980606079 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 118 chid ids of type : 3594 Number RLEs to save : 34512 save missing photos in datou_result : time spend for datou_step_exec : 106.09185838699341 time spend to save output : 3.5815563201904297 total time spend for step 1 : 109.67341470718384 step2:crop_condition Fri Oct 3 11:42:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 14 ! batch 1 Loaded 118 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 59 About to insert : list_path_to_insert length 59 new photo from crops ! About to upload 59 photos upload in portfolio : 3736932 init cache_photo without model_param we have 59 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759484559_3062092 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392102_0.png', 0, 125, 603, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392097_0.png', 0, 390, 368, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392098_0.png', 0, 211, 82, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392101_0.png', 0, 237, 352, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392115_0.png', 0, 301, 414, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392103_0.png', 0, 120, 382, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392111_0.png', 0, 181, 338, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392108_0.png', 0, 166, 241, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392106_0.png', 0, 271, 330, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392114_0.png', 0, 302, 515, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392112_0.png', 0, 154, 318, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392105_0.png', 0, 462, 398, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392113_0.png', 0, 209, 204, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392109_0.png', 0, 115, 187, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392116_0.png', 0, 341, 263, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392119_0.png', 0, 81, 177, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392124_0.png', 0, 650, 329, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392117_0.png', 0, 159, 271, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392122_0.png', 0, 121, 202, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392120_0.png', 0, 277, 154, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392123_0.png', 0, 380, 300, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392126_0.png', 0, 96, 129, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392125_0.png', 0, 218, 162, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392133_0.png', 0, 410, 348, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392134_0.png', 0, 167, 147, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392139_0.png', 0, 293, 272, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392135_0.png', 0, 230, 264, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392142_0.png', 0, 116, 111, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392137_0.png', 0, 146, 235, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392138_0.png', 0, 315, 277, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392140_0.png', 0, 236, 188, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392153_0.png', 0, 100, 95, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392147_0.png', 0, 386, 377, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392152_0.png', 0, 785, 340, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392158_0.png', 0, 221, 327, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392161_0.png', 0, 358, 447, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392160_0.png', 0, 362, 269, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392159_0.png', 0, 122, 221, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392164_0.png', 0, 155, 296, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392169_0.png', 0, 260, 269, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392171_0.png', 0, 256, 90, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392172_0.png', 0, 116, 188, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392168_0.png', 0, 198, 169, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392178_0.png', 0, 370, 588, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392174_0.png', 0, 355, 501, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392190_0.png', 0, 149, 232, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392189_0.png', 0, 369, 331, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392181_0.png', 0, 303, 482, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392187_0.png', 0, 195, 250, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392185_0.png', 0, 178, 194, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392193_0.png', 0, 210, 164, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392194_0.png', 0, 218, 231, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392201_0.png', 0, 134, 208, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392197_0.png', 0, 394, 185, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392204_0.png', 0, 164, 106, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392208_0.png', 0, 140, 293, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392212_0.png', 0, 505, 454, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392205_0.png', 0, 142, 269, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484572), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392209_0.png', 0, 95, 91, 0, 1759484572,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 59 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.010478258132935 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759484586_3062092 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392095_0.png', 0, 350, 298, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392132_0.png', 0, 724, 517, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392155_0.png', 0, 215, 382, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392145_0.png', 0, 201, 192, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392167_0.png', 0, 119, 201, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392165_0.png', 0, 129, 180, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392166_0.png', 0, 169, 176, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392176_0.png', 0, 306, 266, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392173_0.png', 0, 186, 259, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392177_0.png', 0, 268, 347, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392184_0.png', 0, 430, 254, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392195_0.png', 0, 444, 486, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392192_0.png', 0, 364, 327, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392198_0.png', 0, 262, 128, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484590), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392211_0.png', 0, 115, 308, 0, 1759484590,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.8330912590026855 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759484595_3062092 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392141_0.png', 0, 251, 205, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392143_0.png', 0, 307, 146, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392150_0.png', 0, 169, 219, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392151_0.png', 0, 211, 207, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392186_0.png', 0, 209, 269, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392199_0.png', 0, 142, 97, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484597), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392200_0.png', 0, 116, 100, 0, 1759484597,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.6407248973846436 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759484610_3062092 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392100_0.png', 0, 200, 112, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392096_0.png', 0, 355, 340, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392099_0.png', 0, 177, 202, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392107_0.png', 0, 267, 347, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392104_0.png', 0, 418, 443, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392110_0.png', 0, 330, 414, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392121_0.png', 0, 419, 516, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392128_0.png', 0, 209, 289, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392131_0.png', 0, 176, 219, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392129_0.png', 0, 340, 222, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392127_0.png', 0, 318, 473, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392130_0.png', 0, 239, 168, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392144_0.png', 0, 105, 120, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392136_0.png', 0, 368, 287, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392149_0.png', 0, 369, 362, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392154_0.png', 0, 366, 262, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392148_0.png', 0, 417, 481, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392146_0.png', 0, 212, 255, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392157_0.png', 0, 199, 265, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392162_0.png', 0, 257, 286, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392170_0.png', 0, 193, 271, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392163_0.png', 0, 179, 87, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392179_0.png', 0, 276, 234, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392180_0.png', 0, 203, 298, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392175_0.png', 0, 401, 296, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392182_0.png', 0, 299, 411, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392183_0.png', 0, 463, 415, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392188_0.png', 0, 179, 241, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392196_0.png', 0, 115, 74, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392202_0.png', 0, 1009, 175, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392203_0.png', 0, 284, 207, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392206_0.png', 0, 359, 406, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392207_0.png', 0, 378, 338, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484618), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392210_0.png', 0, 119, 152, 0, 1759484618,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.750091552734375 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759484625_3062092 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484625), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392118_0.png', 0, 200, 167, 0, 1759484625,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484625), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392191_0.png', 0, 224, 207, 0, 1759484625,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9455006122589111 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759484628_3062092 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759484628), 0.0, 0.0, 14, '', 0, 0, '1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392156_0.png', 0, 252, 355, 0, 1759484628,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7929739952087402 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1387580013, 1387580008, 1387579996, 1387579983, 1387579979, 1387579972, 1387579926, 1387579920, 1387579892, 1387579877, 1387579872, 1387579868, 1387579865, 1387579862] Looping around the photos to save general results len do output : 118 /1387587733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387587937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580013', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580008', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579996', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579983', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579979', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579972', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579926', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579920', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579892', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579877', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579872', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579868', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579865', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579862', None, None, None, None, None, '3833565') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 368 time used for this insertion : 0.05875110626220703 save_final save missing photos in datou_result : time spend for datou_step_exec : 87.37062883377075 time spend to save output : 0.06324243545532227 total time spend for step 2 : 87.43387126922607 step3:rle_unique_nms_with_priority Fri Oct 3 11:43:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 118 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.9992594718933105 time for calcul the mask position with numpy : 0.693453311920166 nb_pixel_total : 7916090 time to create 1 rle with new method : 0.8879270553588867 time for calcul the mask position with numpy : 0.024172067642211914 nb_pixel_total : 45347 time to create 1 rle with old method : 0.04970669746398926 time for calcul the mask position with numpy : 0.024893999099731445 nb_pixel_total : 50219 time to create 1 rle with old method : 0.05348038673400879 time for calcul the mask position with numpy : 0.023146867752075195 nb_pixel_total : 20100 time to create 1 rle with old method : 0.02168440818786621 time for calcul the mask position with numpy : 0.024715185165405273 nb_pixel_total : 23588 time to create 1 rle with old method : 0.024779081344604492 time for calcul the mask position with numpy : 0.02381443977355957 nb_pixel_total : 12191 time to create 1 rle with old method : 0.013048410415649414 time for calcul the mask position with numpy : 0.024248600006103516 nb_pixel_total : 96631 time to create 1 rle with old method : 0.1042318344116211 time for calcul the mask position with numpy : 0.025387287139892578 nb_pixel_total : 60205 time to create 1 rle with old method : 0.06446433067321777 time for calcul the mask position with numpy : 0.024544954299926758 nb_pixel_total : 70029 time to create 1 rle with old method : 0.07463908195495605 create new chi : 2.2181994915008545 time to delete rle : 0.06731247901916504 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7025 TO DO : save crop sub photo not yet done ! save time : 0.8588728904724121 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 4.747391939163208 time for calcul the mask position with numpy : 0.602154016494751 nb_pixel_total : 7492665 time to create 1 rle with new method : 0.619342565536499 time for calcul the mask position with numpy : 0.025104045867919922 nb_pixel_total : 106487 time to create 1 rle with old method : 0.12242698669433594 time for calcul the mask position with numpy : 0.025785446166992188 nb_pixel_total : 111683 time to create 1 rle with old method : 0.12431740760803223 time for calcul the mask position with numpy : 0.024753332138061523 nb_pixel_total : 29768 time to create 1 rle with old method : 0.03164172172546387 time for calcul the mask position with numpy : 0.024590730667114258 nb_pixel_total : 33827 time to create 1 rle with old method : 0.03687119483947754 time for calcul the mask position with numpy : 0.025339603424072266 nb_pixel_total : 41313 time to create 1 rle with old method : 0.043993234634399414 time for calcul the mask position with numpy : 0.024876832962036133 nb_pixel_total : 63886 time to create 1 rle with old method : 0.06861329078674316 time for calcul the mask position with numpy : 0.023795127868652344 nb_pixel_total : 15731 time to create 1 rle with old method : 0.01656341552734375 time for calcul the mask position with numpy : 0.023184537887573242 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0015442371368408203 time for calcul the mask position with numpy : 0.02438068389892578 nb_pixel_total : 59881 time to create 1 rle with old method : 0.06675577163696289 time for calcul the mask position with numpy : 0.024062395095825195 nb_pixel_total : 63476 time to create 1 rle with old method : 0.06723856925964355 time for calcul the mask position with numpy : 0.02446746826171875 nb_pixel_total : 133703 time to create 1 rle with old method : 0.14721250534057617 time for calcul the mask position with numpy : 0.02494215965270996 nb_pixel_total : 107269 time to create 1 rle with old method : 0.11903977394104004 time for calcul the mask position with numpy : 0.02448558807373047 nb_pixel_total : 33475 time to create 1 rle with old method : 0.036803483963012695 create new chi : 2.472494602203369 time to delete rle : 0.0015332698822021484 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11821 TO DO : save crop sub photo not yet done ! save time : 1.2993733882904053 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 4.758709192276001 time for calcul the mask position with numpy : 0.6171071529388428 nb_pixel_total : 7645891 time to create 1 rle with new method : 0.6289505958557129 time for calcul the mask position with numpy : 0.02383875846862793 nb_pixel_total : 4805 time to create 1 rle with old method : 0.005957841873168945 time for calcul the mask position with numpy : 0.024557113647460938 nb_pixel_total : 16646 time to create 1 rle with old method : 0.018733501434326172 time for calcul the mask position with numpy : 0.025543212890625 nb_pixel_total : 168572 time to create 1 rle with new method : 0.7615766525268555 time for calcul the mask position with numpy : 0.024587631225585938 nb_pixel_total : 71967 time to create 1 rle with old method : 0.08403635025024414 time for calcul the mask position with numpy : 0.02738642692565918 nb_pixel_total : 18420 time to create 1 rle with old method : 0.020746707916259766 time for calcul the mask position with numpy : 0.026719331741333008 nb_pixel_total : 186178 time to create 1 rle with new method : 0.771803617477417 time for calcul the mask position with numpy : 0.032073974609375 nb_pixel_total : 33652 time to create 1 rle with old method : 0.04336857795715332 time for calcul the mask position with numpy : 0.02909994125366211 nb_pixel_total : 13073 time to create 1 rle with old method : 0.014346122741699219 time for calcul the mask position with numpy : 0.025689363479614258 nb_pixel_total : 26075 time to create 1 rle with old method : 0.029924392700195312 time for calcul the mask position with numpy : 0.025205373764038086 nb_pixel_total : 38355 time to create 1 rle with old method : 0.04172706604003906 time for calcul the mask position with numpy : 0.026569604873657227 nb_pixel_total : 70766 time to create 1 rle with old method : 0.07556509971618652 create new chi : 3.5084176063537598 time to delete rle : 0.001161813735961914 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7744 TO DO : save crop sub photo not yet done ! save time : 0.9365460872650146 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.8173251152038574 time for calcul the mask position with numpy : 0.47378015518188477 nb_pixel_total : 7769587 time to create 1 rle with new method : 0.7603635787963867 time for calcul the mask position with numpy : 0.0239260196685791 nb_pixel_total : 11446 time to create 1 rle with old method : 0.012622594833374023 time for calcul the mask position with numpy : 0.024334430694580078 nb_pixel_total : 81627 time to create 1 rle with old method : 0.11510181427001953 time for calcul the mask position with numpy : 0.025841474533081055 nb_pixel_total : 183067 time to create 1 rle with new method : 0.737668514251709 time for calcul the mask position with numpy : 0.02525186538696289 nb_pixel_total : 32612 time to create 1 rle with old method : 0.03726029396057129 time for calcul the mask position with numpy : 0.024257421493530273 nb_pixel_total : 28144 time to create 1 rle with old method : 0.030739307403564453 time for calcul the mask position with numpy : 0.025589942932128906 nb_pixel_total : 39735 time to create 1 rle with old method : 0.042977094650268555 time for calcul the mask position with numpy : 0.024474382400512695 nb_pixel_total : 45324 time to create 1 rle with old method : 0.05065321922302246 time for calcul the mask position with numpy : 0.026764392852783203 nb_pixel_total : 102858 time to create 1 rle with old method : 0.11191439628601074 create new chi : 2.6451854705810547 time to delete rle : 0.0011208057403564453 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7186 TO DO : save crop sub photo not yet done ! save time : 0.882148027420044 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.542176246643066 time for calcul the mask position with numpy : 0.8516669273376465 nb_pixel_total : 7961415 time to create 1 rle with new method : 1.2469978332519531 time for calcul the mask position with numpy : 0.027445316314697266 nb_pixel_total : 9899 time to create 1 rle with old method : 0.016152620315551758 time for calcul the mask position with numpy : 0.02716851234436035 nb_pixel_total : 34624 time to create 1 rle with old method : 0.0504908561706543 time for calcul the mask position with numpy : 0.025879383087158203 nb_pixel_total : 6732 time to create 1 rle with old method : 0.008529901504516602 time for calcul the mask position with numpy : 0.02633380889892578 nb_pixel_total : 39386 time to create 1 rle with old method : 0.044940948486328125 time for calcul the mask position with numpy : 0.026497602462768555 nb_pixel_total : 25756 time to create 1 rle with old method : 0.0297391414642334 time for calcul the mask position with numpy : 0.025278329849243164 nb_pixel_total : 32071 time to create 1 rle with old method : 0.03619098663330078 time for calcul the mask position with numpy : 0.025191783905029297 nb_pixel_total : 46096 time to create 1 rle with old method : 0.051436424255371094 time for calcul the mask position with numpy : 0.024623870849609375 nb_pixel_total : 18861 time to create 1 rle with old method : 0.02290177345275879 time for calcul the mask position with numpy : 0.02585911750793457 nb_pixel_total : 75734 time to create 1 rle with old method : 0.08908700942993164 time for calcul the mask position with numpy : 0.02653813362121582 nb_pixel_total : 43826 time to create 1 rle with old method : 0.04997658729553223 create new chi : 2.807559013366699 time to delete rle : 0.0011417865753173828 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6652 TO DO : save crop sub photo not yet done ! save time : 0.8628191947937012 nb_obj : 12 nb_hashtags : 5 time to prepare the origin masks : 6.000786066055298 time for calcul the mask position with numpy : 0.6316227912902832 nb_pixel_total : 7451576 time to create 1 rle with new method : 0.947268009185791 time for calcul the mask position with numpy : 0.026790142059326172 nb_pixel_total : 57567 time to create 1 rle with old method : 0.06338238716125488 time for calcul the mask position with numpy : 0.024602890014648438 nb_pixel_total : 61739 time to create 1 rle with old method : 0.06628227233886719 time for calcul the mask position with numpy : 0.027411460876464844 nb_pixel_total : 49777 time to create 1 rle with old method : 0.060405731201171875 time for calcul the mask position with numpy : 0.02494645118713379 nb_pixel_total : 6148 time to create 1 rle with old method : 0.006887674331665039 time for calcul the mask position with numpy : 0.02715134620666504 nb_pixel_total : 218878 time to create 1 rle with new method : 0.7325351238250732 time for calcul the mask position with numpy : 0.026462316513061523 nb_pixel_total : 31389 time to create 1 rle with old method : 0.048274993896484375 time for calcul the mask position with numpy : 0.027111053466796875 nb_pixel_total : 28806 time to create 1 rle with old method : 0.03652667999267578 time for calcul the mask position with numpy : 0.024888992309570312 nb_pixel_total : 98856 time to create 1 rle with old method : 0.10875868797302246 time for calcul the mask position with numpy : 0.024836301803588867 nb_pixel_total : 114178 time to create 1 rle with old method : 0.12622451782226562 time for calcul the mask position with numpy : 0.026582002639770508 nb_pixel_total : 108803 time to create 1 rle with old method : 0.12036609649658203 time for calcul the mask position with numpy : 0.025030136108398438 nb_pixel_total : 37631 time to create 1 rle with old method : 0.04236340522766113 time for calcul the mask position with numpy : 0.025124788284301758 nb_pixel_total : 29052 time to create 1 rle with old method : 0.03198361396789551 create new chi : 3.4107742309570312 time to delete rle : 0.001407623291015625 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9454 TO DO : save crop sub photo not yet done ! save time : 1.1403639316558838 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 3.4361047744750977 time for calcul the mask position with numpy : 0.793973445892334 nb_pixel_total : 8027521 time to create 1 rle with new method : 0.6484060287475586 time for calcul the mask position with numpy : 0.02442026138305664 nb_pixel_total : 45492 time to create 1 rle with old method : 0.05088376998901367 time for calcul the mask position with numpy : 0.025516033172607422 nb_pixel_total : 57901 time to create 1 rle with old method : 0.06528353691101074 time for calcul the mask position with numpy : 0.02514028549194336 nb_pixel_total : 63838 time to create 1 rle with old method : 0.07223749160766602 time for calcul the mask position with numpy : 0.024657011032104492 nb_pixel_total : 18965 time to create 1 rle with old method : 0.02077341079711914 time for calcul the mask position with numpy : 0.024844884872436523 nb_pixel_total : 39265 time to create 1 rle with old method : 0.04314899444580078 time for calcul the mask position with numpy : 0.02422785758972168 nb_pixel_total : 41418 time to create 1 rle with old method : 0.045485496520996094 create new chi : 1.9344966411590576 time to delete rle : 0.0008602142333984375 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 6014 TO DO : save crop sub photo not yet done ! save time : 0.7919611930847168 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.4181809425354 time for calcul the mask position with numpy : 0.6485216617584229 nb_pixel_total : 8040675 time to create 1 rle with new method : 0.8532726764678955 time for calcul the mask position with numpy : 0.03166532516479492 nb_pixel_total : 17199 time to create 1 rle with old method : 0.019145488739013672 time for calcul the mask position with numpy : 0.040090084075927734 nb_pixel_total : 17666 time to create 1 rle with old method : 0.019892454147338867 time for calcul the mask position with numpy : 0.04079794883728027 nb_pixel_total : 39511 time to create 1 rle with old method : 0.04781484603881836 time for calcul the mask position with numpy : 0.041016578674316406 nb_pixel_total : 60639 time to create 1 rle with old method : 0.0653696060180664 time for calcul the mask position with numpy : 0.040308475494384766 nb_pixel_total : 18429 time to create 1 rle with old method : 0.029949426651000977 time for calcul the mask position with numpy : 0.045870065689086914 nb_pixel_total : 19247 time to create 1 rle with old method : 0.021508216857910156 time for calcul the mask position with numpy : 0.03773927688598633 nb_pixel_total : 20978 time to create 1 rle with old method : 0.022726058959960938 time for calcul the mask position with numpy : 0.03386807441711426 nb_pixel_total : 14359 time to create 1 rle with old method : 0.015930652618408203 time for calcul the mask position with numpy : 0.024707794189453125 nb_pixel_total : 33916 time to create 1 rle with old method : 0.03745889663696289 time for calcul the mask position with numpy : 0.0242459774017334 nb_pixel_total : 11781 time to create 1 rle with old method : 0.012787342071533203 create new chi : 2.199214220046997 time to delete rle : 0.0015778541564941406 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 6086 TO DO : save crop sub photo not yet done ! save time : 0.7748115062713623 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.810216188430786 time for calcul the mask position with numpy : 0.8051052093505859 nb_pixel_total : 7751275 time to create 1 rle with new method : 0.8142256736755371 time for calcul the mask position with numpy : 0.0369105339050293 nb_pixel_total : 35460 time to create 1 rle with old method : 0.03885793685913086 time for calcul the mask position with numpy : 0.0248260498046875 nb_pixel_total : 46566 time to create 1 rle with old method : 0.05255532264709473 time for calcul the mask position with numpy : 0.02579474449157715 nb_pixel_total : 166773 time to create 1 rle with new method : 0.782041072845459 time for calcul the mask position with numpy : 0.03911399841308594 nb_pixel_total : 47270 time to create 1 rle with old method : 0.05111098289489746 time for calcul the mask position with numpy : 0.04030013084411621 nb_pixel_total : 47324 time to create 1 rle with old method : 0.05292963981628418 time for calcul the mask position with numpy : 0.04697299003601074 nb_pixel_total : 52866 time to create 1 rle with old method : 0.061167240142822266 time for calcul the mask position with numpy : 0.029623746871948242 nb_pixel_total : 116205 time to create 1 rle with old method : 0.16221046447753906 time for calcul the mask position with numpy : 0.025125741958618164 nb_pixel_total : 30661 time to create 1 rle with old method : 0.034604549407958984 create new chi : 3.189542055130005 time to delete rle : 0.0017733573913574219 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7876 TO DO : save crop sub photo not yet done ! save time : 0.9363131523132324 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 5.3872668743133545 time for calcul the mask position with numpy : 0.5119445323944092 nb_pixel_total : 7640307 time to create 1 rle with new method : 0.6826376914978027 time for calcul the mask position with numpy : 0.024950742721557617 nb_pixel_total : 34322 time to create 1 rle with old method : 0.03963923454284668 time for calcul the mask position with numpy : 0.023094892501831055 nb_pixel_total : 25194 time to create 1 rle with old method : 0.027672529220581055 time for calcul the mask position with numpy : 0.024544954299926758 nb_pixel_total : 81073 time to create 1 rle with old method : 0.08683109283447266 time for calcul the mask position with numpy : 0.0234830379486084 nb_pixel_total : 28341 time to create 1 rle with old method : 0.030570030212402344 time for calcul the mask position with numpy : 0.038567304611206055 nb_pixel_total : 12028 time to create 1 rle with old method : 0.013210296630859375 time for calcul the mask position with numpy : 0.039641618728637695 nb_pixel_total : 37678 time to create 1 rle with old method : 0.042305707931518555 time for calcul the mask position with numpy : 0.035112857818603516 nb_pixel_total : 24168 time to create 1 rle with old method : 0.02695178985595703 time for calcul the mask position with numpy : 0.02451014518737793 nb_pixel_total : 56470 time to create 1 rle with old method : 0.0626213550567627 time for calcul the mask position with numpy : 0.026248455047607422 nb_pixel_total : 161023 time to create 1 rle with new method : 0.7609748840332031 time for calcul the mask position with numpy : 0.025316476821899414 nb_pixel_total : 94902 time to create 1 rle with old method : 0.10400962829589844 time for calcul the mask position with numpy : 0.024809598922729492 nb_pixel_total : 98894 time to create 1 rle with old method : 0.10593247413635254 create new chi : 2.8792130947113037 time to delete rle : 0.0014705657958984375 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8858 TO DO : save crop sub photo not yet done ! save time : 1.072608470916748 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.993259906768799 time for calcul the mask position with numpy : 0.5899567604064941 nb_pixel_total : 7980241 time to create 1 rle with new method : 0.7294058799743652 time for calcul the mask position with numpy : 0.023780345916748047 nb_pixel_total : 6991 time to create 1 rle with old method : 0.007611513137817383 time for calcul the mask position with numpy : 0.02526688575744629 nb_pixel_total : 176944 time to create 1 rle with new method : 0.7568790912628174 time for calcul the mask position with numpy : 0.02396845817565918 nb_pixel_total : 32559 time to create 1 rle with old method : 0.03564763069152832 time for calcul the mask position with numpy : 0.024888038635253906 nb_pixel_total : 23303 time to create 1 rle with old method : 0.025693416595458984 time for calcul the mask position with numpy : 0.024447202682495117 nb_pixel_total : 74362 time to create 1 rle with old method : 0.08122730255126953 create new chi : 2.418717384338379 time to delete rle : 0.0007905960083007812 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5198 TO DO : save crop sub photo not yet done ! save time : 0.7173285484313965 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.705396890640259 time for calcul the mask position with numpy : 0.6153011322021484 nb_pixel_total : 8194038 time to create 1 rle with new method : 0.881831169128418 time for calcul the mask position with numpy : 0.024315357208251953 nb_pixel_total : 16532 time to create 1 rle with old method : 0.018300533294677734 time for calcul the mask position with numpy : 0.024065256118774414 nb_pixel_total : 7589 time to create 1 rle with old method : 0.00874638557434082 time for calcul the mask position with numpy : 0.023504257202148438 nb_pixel_total : 10223 time to create 1 rle with old method : 0.011497259140014648 time for calcul the mask position with numpy : 0.024055004119873047 nb_pixel_total : 22166 time to create 1 rle with old method : 0.024694442749023438 time for calcul the mask position with numpy : 0.02513575553894043 nb_pixel_total : 43852 time to create 1 rle with old method : 0.04851865768432617 create new chi : 1.7725813388824463 time to delete rle : 0.0006573200225830078 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3702 TO DO : save crop sub photo not yet done ! save time : 0.533686637878418 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.863271951675415 time for calcul the mask position with numpy : 0.7372527122497559 nb_pixel_total : 8125297 time to create 1 rle with new method : 1.027979850769043 time for calcul the mask position with numpy : 0.042272329330444336 nb_pixel_total : 12560 time to create 1 rle with old method : 0.014394760131835938 time for calcul the mask position with numpy : 0.02556157112121582 nb_pixel_total : 45510 time to create 1 rle with old method : 0.05083346366882324 time for calcul the mask position with numpy : 0.027648448944091797 nb_pixel_total : 111033 time to create 1 rle with old method : 0.12413907051086426 create new chi : 2.100059986114502 time to delete rle : 0.0005309581756591797 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3158 TO DO : save crop sub photo not yet done ! save time : 0.4823758602142334 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.045583248138428 time for calcul the mask position with numpy : 0.8250129222869873 nb_pixel_total : 7910701 time to create 1 rle with new method : 0.8283941745758057 time for calcul the mask position with numpy : 0.024357318878173828 nb_pixel_total : 122202 time to create 1 rle with old method : 0.13576650619506836 time for calcul the mask position with numpy : 0.026476383209228516 nb_pixel_total : 21642 time to create 1 rle with old method : 0.024152755737304688 time for calcul the mask position with numpy : 0.024217605590820312 nb_pixel_total : 14273 time to create 1 rle with old method : 0.015834808349609375 time for calcul the mask position with numpy : 0.02371692657470703 nb_pixel_total : 6264 time to create 1 rle with old method : 0.006747245788574219 time for calcul the mask position with numpy : 0.024661779403686523 nb_pixel_total : 27352 time to create 1 rle with old method : 0.030089378356933594 time for calcul the mask position with numpy : 0.02457737922668457 nb_pixel_total : 95866 time to create 1 rle with old method : 0.10448503494262695 time for calcul the mask position with numpy : 0.025883913040161133 nb_pixel_total : 74194 time to create 1 rle with old method : 0.08230137825012207 time for calcul the mask position with numpy : 0.027156352996826172 nb_pixel_total : 21906 time to create 1 rle with old method : 0.02431464195251465 create new chi : 2.3198671340942383 time to delete rle : 0.00177001953125 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 7508 TO DO : save crop sub photo not yet done ! save time : 0.9425034523010254 map_output_result : {1387580013: (0.0, 'Should be the crop_list due to order', 0), 1387580008: (0.0, 'Should be the crop_list due to order', 0), 1387579996: (0.0, 'Should be the crop_list due to order', 0), 1387579983: (0.0, 'Should be the crop_list due to order', 0), 1387579979: (0.0, 'Should be the crop_list due to order', 0), 1387579972: (0.0, 'Should be the crop_list due to order', 0), 1387579926: (0.0, 'Should be the crop_list due to order', 0), 1387579920: (0.0, 'Should be the crop_list due to order', 0), 1387579892: (0.0, 'Should be the crop_list due to order', 0), 1387579877: (0.0, 'Should be the crop_list due to order', 0), 1387579872: (0.0, 'Should be the crop_list due to order', 0), 1387579868: (0.0, 'Should be the crop_list due to order', 0), 1387579865: (0.0, 'Should be the crop_list due to order', 0), 1387579862: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1387580013, 1387580008, 1387579996, 1387579983, 1387579979, 1387579972, 1387579926, 1387579920, 1387579892, 1387579877, 1387579872, 1387579868, 1387579865, 1387579862] Looping around the photos to save general results len do output : 14 /1387580013.Didn't retrieve data . /1387580008.Didn't retrieve data . /1387579996.Didn't retrieve data . /1387579983.Didn't retrieve data . /1387579979.Didn't retrieve data . /1387579972.Didn't retrieve data . /1387579926.Didn't retrieve data . /1387579920.Didn't retrieve data . /1387579892.Didn't retrieve data . /1387579877.Didn't retrieve data . /1387579872.Didn't retrieve data . /1387579868.Didn't retrieve data . /1387579865.Didn't retrieve data . /1387579862.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580013', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580008', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579996', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579983', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579979', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579972', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579926', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579920', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579892', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579877', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579872', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579868', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579865', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579862', None, None, None, None, None, '3833565') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.03620433807373047 save_final save missing photos in datou_result : time spend for datou_step_exec : 106.77375769615173 time spend to save output : 0.03779864311218262 total time spend for step 3 : 106.81155633926392 step4:ventilate_hashtags_in_portfolio Fri Oct 3 11:45:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27485662 get user id for portfolio 27485662 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27485662 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','autre','flou','pehd','background','carton','pet_fonce','pet_clair','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27485662 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','autre','flou','pehd','background','carton','pet_fonce','pet_clair','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27485662 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','autre','flou','pehd','background','carton','pet_fonce','pet_clair','mal_croppe','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27486187,27486188,27486189,27486190,27486191,27486192,27486193,27486194,27486195,27486196,27486197?tags=environnement,papier,autre,flou,pehd,background,carton,pet_fonce,pet_clair,mal_croppe,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1387580013, 1387580008, 1387579996, 1387579983, 1387579979, 1387579972, 1387579926, 1387579920, 1387579892, 1387579877, 1387579872, 1387579868, 1387579865, 1387579862] Looping around the photos to save general results len do output : 1 /27485662. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580013', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580008', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579996', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579983', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579979', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579972', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579926', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579920', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579892', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579877', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579872', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579868', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579865', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579862', None, None, None, None, None, '3833565') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.03846120834350586 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.59037184715271 time spend to save output : 0.038980722427368164 total time spend for step 4 : 5.629352569580078 step5:final Fri Oct 3 11:45:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1387580013: ('0.053515633611662276',), 1387580008: ('0.053515633611662276',), 1387579996: ('0.053515633611662276',), 1387579983: ('0.053515633611662276',), 1387579979: ('0.053515633611662276',), 1387579972: ('0.053515633611662276',), 1387579926: ('0.053515633611662276',), 1387579920: ('0.053515633611662276',), 1387579892: ('0.053515633611662276',), 1387579877: ('0.053515633611662276',), 1387579872: ('0.053515633611662276',), 1387579868: ('0.053515633611662276',), 1387579865: ('0.053515633611662276',), 1387579862: ('0.053515633611662276',)} new output for save of step final : {1387580013: ('0.053515633611662276',), 1387580008: ('0.053515633611662276',), 1387579996: ('0.053515633611662276',), 1387579983: ('0.053515633611662276',), 1387579979: ('0.053515633611662276',), 1387579972: ('0.053515633611662276',), 1387579926: ('0.053515633611662276',), 1387579920: ('0.053515633611662276',), 1387579892: ('0.053515633611662276',), 1387579877: ('0.053515633611662276',), 1387579872: ('0.053515633611662276',), 1387579868: ('0.053515633611662276',), 1387579865: ('0.053515633611662276',), 1387579862: ('0.053515633611662276',)} [1387580013, 1387580008, 1387579996, 1387579983, 1387579979, 1387579972, 1387579926, 1387579920, 1387579892, 1387579877, 1387579872, 1387579868, 1387579865, 1387579862] Looping around the photos to save general results len do output : 14 /1387580013.Didn't retrieve data . /1387580008.Didn't retrieve data . /1387579996.Didn't retrieve data . /1387579983.Didn't retrieve data . /1387579979.Didn't retrieve data . /1387579972.Didn't retrieve data . /1387579926.Didn't retrieve data . /1387579920.Didn't retrieve data . /1387579892.Didn't retrieve data . /1387579877.Didn't retrieve data . /1387579872.Didn't retrieve data . /1387579868.Didn't retrieve data . /1387579865.Didn't retrieve data . /1387579862.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580013', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580008', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579996', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579983', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579979', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579972', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579926', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579920', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579892', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579877', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579872', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579868', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579865', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579862', None, None, None, None, None, '3833565') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.03737378120422363 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.38543224334716797 time spend to save output : 0.03857064247131348 total time spend for step 5 : 0.42400288581848145 step6:blur_detection Fri Oct 3 11:45:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959.jpg resize: (2160, 3840) 1387580013 -6.944479532276745 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd.jpg resize: (2160, 3840) 1387580008 -7.0224464404331455 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20.jpg resize: (2160, 3840) 1387579996 -7.0344131757924115 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7.jpg resize: (2160, 3840) 1387579983 -6.98842448716665 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31.jpg resize: (2160, 3840) 1387579979 -7.05836064090857 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79.jpg resize: (2160, 3840) 1387579972 -7.097951811023442 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95.jpg resize: (2160, 3840) 1387579926 -6.860835576504699 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9.jpg resize: (2160, 3840) 1387579920 -6.9516988579496175 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9.jpg resize: (2160, 3840) 1387579892 -7.1417214962164595 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d.jpg resize: (2160, 3840) 1387579877 -6.931538846800002 treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee.jpg resize: (2160, 3840) 1387579872 -7.0902279352038695 treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b.jpg resize: (2160, 3840) 1387579868 -3.908981041333751 treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e.jpg resize: (2160, 3840) 1387579865 -6.138413404563637 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2.jpg resize: (2160, 3840) 1387579862 -7.009479147955892 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392102_0.png resize: (603, 125) 1387587733 -3.6847939523389295 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392097_0.png resize: (368, 390) 1387587734 -4.549735050078057 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392098_0.png resize: (82, 211) 1387587735 -4.216231076542206 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392101_0.png resize: (352, 237) 1387587736 -3.766891024521745 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392115_0.png resize: (414, 301) 1387587737 -4.960746711635939 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392103_0.png resize: (382, 120) 1387587738 -4.00412327322876 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392111_0.png resize: (338, 181) 1387587739 -3.921965654013136 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392108_0.png resize: (241, 166) 1387587740 -4.886424842173185 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392106_0.png resize: (330, 271) 1387587741 -4.326421155289965 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392114_0.png resize: (515, 302) 1387587742 -5.049388112898009 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392112_0.png resize: (318, 154) 1387587743 -4.081308847495289 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392105_0.png resize: (398, 462) 1387587744 -3.733713955296942 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392113_0.png resize: (204, 209) 1387587745 -4.059553912662797 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392109_0.png resize: (187, 115) 1387587746 -3.990030783978908 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392116_0.png resize: (263, 341) 1387587747 -5.3404627498217945 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392119_0.png resize: (177, 81) 1387587748 -4.496855816702267 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392124_0.png resize: (329, 650) 1387587749 -5.207676548457613 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392117_0.png resize: (271, 159) 1387587750 -4.706369700001569 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392122_0.png resize: (202, 121) 1387587751 -4.974093160703831 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392120_0.png resize: (154, 277) 1387587752 -4.701791532470628 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392123_0.png resize: (300, 380) 1387587753 -3.0667886389776298 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392126_0.png resize: (129, 96) 1387587754 -3.272060311115629 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392125_0.png resize: (162, 218) 1387587755 -4.356353737225031 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392133_0.png resize: (348, 410) 1387587756 -4.599559199014701 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392134_0.png resize: (147, 167) 1387587757 -4.117110501108027 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392139_0.png resize: (272, 293) 1387587758 -2.805780122665428 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392135_0.png resize: (264, 230) 1387587759 -4.081819190765259 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392142_0.png resize: (111, 116) 1387587760 -4.039455033650956 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392137_0.png resize: (235, 146) 1387587761 -3.512156705994594 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392138_0.png resize: (277, 315) 1387587762 -3.525697949268642 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392140_0.png resize: (188, 236) 1387587763 -3.734659476067047 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392153_0.png resize: (95, 100) 1387587764 -4.496052449659116 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392147_0.png resize: (377, 386) 1387587765 -4.556474101645733 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392152_0.png resize: (340, 785) 1387587766 -3.024287894385638 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392158_0.png resize: (327, 221) 1387587767 -4.510707227312271 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392161_0.png resize: (447, 358) 1387587768 -2.724095842747815 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392160_0.png resize: (269, 362) 1387587769 -4.22193800129776 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392159_0.png resize: (221, 122) 1387587770 -1.9763459236896266 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392164_0.png resize: (296, 155) 1387587771 -3.9318225589848823 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392169_0.png resize: (269, 260) 1387587772 -4.957878195120161 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392171_0.png resize: (90, 256) 1387587773 -4.389647984216032 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392172_0.png resize: (188, 116) 1387587774 -3.3987673432548027 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392168_0.png resize: (169, 198) 1387587775 -3.283008653555658 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392178_0.png resize: (588, 370) 1387587776 -5.037411748976154 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392174_0.png resize: (501, 355) 1387587777 -5.344587394011637 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392190_0.png resize: (232, 149) 1387587778 -2.383630335502189 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392189_0.png resize: (331, 369) 1387587779 -3.0430003931097938 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392181_0.png resize: (482, 303) 1387587781 -2.405038858900861 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392187_0.png resize: (250, 195) 1387587783 -3.25145671003281 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392185_0.png resize: (194, 178) 1387587784 -4.1063833628615765 treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392193_0.png resize: (164, 210) 1387587785 -4.349581512937104 treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392194_0.png resize: (231, 218) 1387587786 -4.199514913658522 treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392201_0.png resize: (208, 134) 1387587787 -4.437171939356881 treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392197_0.png resize: (185, 394) 1387587788 -4.844499033726857 treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392204_0.png resize: (106, 164) 1387587789 -4.356198311237873 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392208_0.png resize: (293, 140) 1387587790 -3.546143487186924 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392212_0.png resize: (454, 505) 1387587791 -4.254257855416597 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392205_0.png resize: (269, 142) 1387587792 -4.065374368033889 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392209_0.png resize: (91, 95) 1387587793 -4.401371587435116 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392095_0.png resize: (298, 350) 1387587796 -1.7352018297375738 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392132_0.png resize: (517, 724) 1387587797 -4.626786697036941 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392155_0.png resize: (382, 215) 1387587798 -4.517125020750636 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392145_0.png resize: (192, 201) 1387587799 -3.952975629668652 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392167_0.png resize: (201, 119) 1387587800 -4.153711090176175 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392165_0.png resize: (180, 129) 1387587801 -3.688441274468571 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392166_0.png resize: (176, 169) 1387587802 -3.6906926649427114 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392176_0.png resize: (266, 306) 1387587803 -4.083377057788412 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392173_0.png resize: (259, 186) 1387587804 -4.328976948139629 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392177_0.png resize: (347, 268) 1387587805 -3.308349966648773 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392184_0.png resize: (254, 430) 1387587806 -2.2467496931113433 treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392195_0.png resize: (486, 444) 1387587813 -5.70401573409256 treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392192_0.png resize: (327, 364) 1387587814 -3.2044854414967605 treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392198_0.png resize: (128, 262) 1387587815 -4.573055182237684 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392211_0.png resize: (308, 115) 1387587816 -3.5222321789772044 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392141_0.png resize: (205, 251) 1387587845 -4.69552800139576 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392143_0.png resize: (146, 307) 1387587846 -3.8368432877743968 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392150_0.png resize: (219, 169) 1387587847 -4.951904337185793 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392151_0.png resize: (207, 211) 1387587848 -5.7455377358564075 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392186_0.png resize: (269, 209) 1387587849 -4.791902653301441 treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392199_0.png resize: (97, 142) 1387587850 -5.1217726009346904 treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392200_0.png resize: (100, 116) 1387587851 -3.728624446184182 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392100_0.png resize: (112, 200) 1387587872 -3.8409179790617327 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392096_0.png resize: (340, 355) 1387587873 -4.395945710806483 treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392099_0.png resize: (202, 177) 1387587874 -3.9354974482463354 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392107_0.png resize: (347, 267) 1387587875 -5.230870364263777 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392104_0.png resize: (443, 418) 1387587876 -5.495739516916359 treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392110_0.png resize: (414, 330) 1387587877 -4.44898000441899 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392121_0.png resize: (516, 419) 1387587878 -5.07659001262022 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392128_0.png resize: (289, 209) 1387587879 -4.631346092494373 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392131_0.png resize: (219, 176) 1387587880 -5.443384507441726 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392129_0.png resize: (222, 340) 1387587881 -3.6346677639169425 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392127_0.png resize: (473, 318) 1387587883 -3.9782278048809463 treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392130_0.png resize: (168, 239) 1387587884 -5.019029661322672 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392144_0.png resize: (120, 105) 1387587885 -4.340242639250148 treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392136_0.png resize: (287, 368) 1387587886 -3.889654132927244 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392149_0.png resize: (362, 369) 1387587887 -5.149167389552037 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392154_0.png resize: (262, 366) 1387587893 -4.2673519641797695 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392148_0.png resize: (481, 417) 1387587895 -4.350428103638148 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392146_0.png resize: (255, 212) 1387587896 -4.7574933853291865 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392157_0.png resize: (265, 199) 1387587897 -4.371516686867059 treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392162_0.png resize: (286, 257) 1387587898 -4.887426046826926 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392170_0.png resize: (271, 193) 1387587908 -4.1145545772164045 treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392163_0.png resize: (87, 179) 1387587918 -2.9781108871078543 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392179_0.png resize: (234, 276) 1387587919 -4.88706236302805 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392180_0.png resize: (298, 203) 1387587920 -4.60312274711374 treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392175_0.png resize: (296, 401) 1387587922 -3.7077783377430387 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392182_0.png resize: (411, 299) 1387587923 -4.019992965905792 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392183_0.png resize: (415, 463) 1387587924 -4.272029574077918 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392188_0.png resize: (241, 179) 1387587925 -5.157371844411836 treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392196_0.png resize: (74, 115) 1387587926 -3.7565694524772026 treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392202_0.png resize: (175, 1009) 1387587927 -2.5167100754435063 treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392203_0.png resize: (207, 284) 1387587930 -4.940799790809367 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392206_0.png resize: (406, 359) 1387587931 -4.97421681979009 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392207_0.png resize: (338, 378) 1387587932 -5.139603997568765 treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392210_0.png resize: (152, 119) 1387587933 -5.061088468403183 treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392118_0.png resize: (167, 200) 1387587934 -3.1117721270282326 treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392191_0.png resize: (207, 224) 1387587936 -5.18426808993531 treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392156_0.png resize: (355, 252) 1387587937 -4.199651533092224 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.040378570556640625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.07456231117248535 save missing photos in datou_result : time spend for datou_step_exec : 63.698493242263794 time spend to save output : 0.1335437297821045 total time spend for step 6 : 63.8320369720459 step7:brightness Fri Oct 3 11:46:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959.jpg treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd.jpg treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20.jpg treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7.jpg treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31.jpg treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79.jpg treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95.jpg treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9.jpg treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9.jpg treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d.jpg treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee.jpg treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b.jpg treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e.jpg treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2.jpg treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392102_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392097_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392098_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392101_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392115_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392103_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392111_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392108_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392106_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392114_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392112_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392105_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392113_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392109_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392116_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392119_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392124_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392117_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392122_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392120_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392123_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392126_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392125_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392133_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392134_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392139_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392135_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392142_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392137_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392138_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392140_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392153_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392147_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392152_0.png treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392158_0.png treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392161_0.png treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392160_0.png treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392159_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392164_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392169_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392171_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392172_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392168_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392178_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392174_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392190_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392189_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392181_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392187_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392185_0.png treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392193_0.png treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392194_0.png treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392201_0.png treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392197_0.png treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392204_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392208_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392212_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392205_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392209_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392095_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392132_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392155_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392145_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392167_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392165_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392166_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392176_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392173_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392177_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392184_0.png treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392195_0.png treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392192_0.png treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392198_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392211_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392141_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392143_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392150_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392151_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392186_0.png treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392199_0.png treat image : temp/1759484428_3062092_1387579868_518eb54757f454740ef4c8f8f7aa264b_rle_crop_3985392200_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392100_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392096_0.png treat image : temp/1759484428_3062092_1387580013_7204d9aa1030f2c6270a62952aa7e959_rle_crop_3985392099_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392107_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392104_0.png treat image : temp/1759484428_3062092_1387580008_57a372064111be65d4e4648e4c2502dd_rle_crop_3985392110_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392121_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392128_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392131_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392129_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392127_0.png treat image : temp/1759484428_3062092_1387579983_09beb99e22e215e4a681a1bc44b0cef7_rle_crop_3985392130_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392144_0.png treat image : temp/1759484428_3062092_1387579979_7c48435f231ba68290d59564b039ad31_rle_crop_3985392136_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392149_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392154_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392148_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392146_0.png treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392157_0.png treat image : temp/1759484428_3062092_1387579926_f4510c5fdeca9790c7adc65b028b9f95_rle_crop_3985392162_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392170_0.png treat image : temp/1759484428_3062092_1387579920_2547d0a9dc8c7b7de3bc646c7914f2b9_rle_crop_3985392163_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392179_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392180_0.png treat image : temp/1759484428_3062092_1387579892_77b01fb853837a730ab74ef2713b05a9_rle_crop_3985392175_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392182_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392183_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392188_0.png treat image : temp/1759484428_3062092_1387579872_500e0a042699c722bcd5823b06c27bee_rle_crop_3985392196_0.png treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392202_0.png treat image : temp/1759484428_3062092_1387579865_06a4c3f7f91382eedd0b424c721d074e_rle_crop_3985392203_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392206_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392207_0.png treat image : temp/1759484428_3062092_1387579862_44d58388b1713c84bfc84b4d37f065d2_rle_crop_3985392210_0.png treat image : temp/1759484428_3062092_1387579996_090a78310d6c7a0fc102bace98e57b20_rle_crop_3985392118_0.png treat image : temp/1759484428_3062092_1387579877_7d18f841e091543e0512b1de4b6a294d_rle_crop_3985392191_0.png treat image : temp/1759484428_3062092_1387579972_5c5734ea31f91a3b14acc92c87823b79_rle_crop_3985392156_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.04727482795715332 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.08338403701782227 save missing photos in datou_result : time spend for datou_step_exec : 14.721042394638062 time spend to save output : 0.14812064170837402 total time spend for step 7 : 14.869163036346436 step8:velours_tree Fri Oct 3 11:47:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.36469483375549316 time spend to save output : 0.0001842975616455078 total time spend for step 8 : 0.36487913131713867 step9:send_mail_cod Fri Oct 3 11:47:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27485662_03-10-2025_11_47_00.pdf 27486188 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274861881759484820 27486189 change filename to text .change filename to text .imagette274861891759484822 27486190 imagette274861901759484822 27486191 imagette274861911759484822 27486192 imagette274861921759484822 27486193 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274861931759484822 27486194 change filename to text .imagette274861941759484824 27486195 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274861951759484824 27486196 imagette274861961759484826 27486197 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274861971759484826 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27485662 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27486187,27486188,27486189,27486190,27486191,27486192,27486193,27486194,27486195,27486196,27486197?tags=environnement,papier,autre,flou,pehd,background,carton,pet_fonce,pet_clair,mal_croppe,metal args[1387580013] : ((1387580013, -6.944479532276745, 492609224), (1387580013, 0.2379736453232921, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387580008] : ((1387580008, -7.0224464404331455, 492609224), (1387580008, 0.1506734603267036, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579996] : ((1387579996, -7.0344131757924115, 492609224), (1387579996, 0.0875692803553181, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579983] : ((1387579983, -6.98842448716665, 492609224), (1387579983, 0.28356341803997953, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579979] : ((1387579979, -7.05836064090857, 492609224), (1387579979, 0.1766849029079556, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579972] : ((1387579972, -7.097951811023442, 492609224), (1387579972, 0.1508257533403246, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579926] : ((1387579926, -6.860835576504699, 492609224), (1387579926, 0.11594375070519149, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579920] : ((1387579920, -6.9516988579496175, 492609224), (1387579920, 0.10677480362622811, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579892] : ((1387579892, -7.1417214962164595, 492609224), (1387579892, 0.11837526014837123, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579877] : ((1387579877, -6.931538846800002, 492609224), (1387579877, 0.059727042419417134, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579872] : ((1387579872, -7.0902279352038695, 492609224), (1387579872, -0.05212914925695848, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579868] : ((1387579868, -3.908981041333751, 492609224), (1387579868, -1.9657107188912268, 501862349), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579865] : ((1387579865, -6.138413404563637, 492609224), (1387579865, -0.6800159320987339, 501862349), '0.053515633611662276') We are sending mail with results at report@fotonower.com args[1387579862] : ((1387579862, -7.009479147955892, 492609224), (1387579862, -0.0007711148117461343, 2107752395), '0.053515633611662276') We are sending mail with results at report@fotonower.com refus_total : 0.053515633611662276 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27485662 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27485662_03-10-2025_11_47_00.pdf results_Auto_P27485662_03-10-2025_11_47_00.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27485662_03-10-2025_11_47_00.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27485662','results_Auto_P27485662_03-10-2025_11_47_00.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27485662_03-10-2025_11_47_00.pdf','pdf','','0.87','0.053515633611662276') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27485662

https://www.fotonower.com/image?json=false&list_photos_id=1387580013
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387580008
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579996
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579983
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579979
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579972
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579926
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579920
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579892
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579877
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579872
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579868
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579865
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387579862
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.35%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/27486188?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27486189?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27486193?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27486194?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27486195?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27486197?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27485662_03-10-2025_11_47_00.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27486187,27486188,27486189,27486190,27486191,27486192,27486193,27486194,27486195,27486196,27486197?tags=environnement,papier,autre,flou,pehd,background,carton,pet_fonce,pet_clair,mal_croppe,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 03 Oct 2025 09:47:11 GMT Content-Length: 0 Connection: close X-Message-Id: JzpTESOxTgCRURvcrkKAWw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1387580013, 1387580008, 1387579996, 1387579983, 1387579979, 1387579972, 1387579926, 1387579920, 1387579892, 1387579877, 1387579872, 1387579868, 1387579865, 1387579862] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580013', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580008', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579996', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579983', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579979', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579972', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579926', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579920', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579892', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579877', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579872', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579868', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579865', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579862', None, None, None, None, None, '3833565') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.041158199310302734 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.288569688796997 time spend to save output : 0.04142045974731445 total time spend for step 9 : 11.329990148544312 step10:split_time_score Fri Oct 3 11:47:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 14),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03102025 27485662 Nombre de photos uploadées : 14 / 23040 (0%) 03102025 27485662 Nombre de photos taguées (types de déchets): 0 / 14 (0%) 03102025 27485662 Nombre de photos taguées (volume) : 0 / 14 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 ?????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010275840759277344 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6435537338256836 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.01748878970893063 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27473887_03-10-2025_07_31_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27473887 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27473887 AND mptpi.`type`=3726 To do Qualite : 0.04494256855048339 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27480976_03-10-2025_09_51_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27480976 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27480976 AND mptpi.`type`=3726 To do Qualite : 0.030411793988759758 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27480980_03-10-2025_09_46_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27480980 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27480980 AND mptpi.`type`=3726 To do Qualite : 0.053515633611662276 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27485662_03-10-2025_11_47_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27485662 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27485662 AND mptpi.`type`=3594 To do Qualite : 0.029711582112811292 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27485667_03-10-2025_11_46_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27485667 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27485667 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03102025': {'nb_upload': 14, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1387580013, 1387580008, 1387579996, 1387579983, 1387579979, 1387579972, 1387579926, 1387579920, 1387579892, 1387579877, 1387579872, 1387579868, 1387579865, 1387579862] Looping around the photos to save general results len do output : 1 /27485662Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580013', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387580008', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579996', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579983', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579979', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579972', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579926', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579920', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579892', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579877', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579872', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579868', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579865', None, None, None, None, None, '3833565') ('3318', None, None, None, None, None, None, None, '3833565') ('3318', '27485662', '1387579862', None, None, None, None, None, '3833565') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.03782391548156738 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.296741008758545 time spend to save output : 0.03821301460266113 total time spend for step 10 : 2.334954023361206 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 14 set_done_treatment 157.82user 174.30system 6:50.07elapsed 80%CPU (0avgtext+0avgdata 4751092maxresident)k 1724080inputs+141032outputs (29582major+15971466minor)pagefaults 0swaps