python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3594778 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4049647'] with mtr_portfolio_ids : ['28540305'] and first list_photo_ids : [] new path : /proc/3594778/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 19 ; length of list_pids : 19 ; length of list_args : 19 time to download the photos : 2.8563144207000732 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Nov 14 17:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-14 17:40:33.370203: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-14 17:40:33.394580: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-14 17:40:33.396609: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe27c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-14 17:40:33.396654: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-14 17:40:33.400058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-14 17:40:33.520665: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4043f550 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-14 17:40:33.520705: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-14 17:40:33.521904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-14 17:40:33.522261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-14 17:40:33.524453: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-14 17:40:33.526422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-14 17:40:33.526828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-14 17:40:33.529239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-14 17:40:33.530595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-14 17:40:33.535525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-14 17:40:33.537299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-14 17:40:33.537395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-14 17:40:33.538334: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-14 17:40:33.538353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-14 17:40:33.538363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-14 17:40:33.543580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-14 17:40:33.859479: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-14 17:40:33.859558: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-14 17:40:33.859574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-14 17:40:33.859590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-14 17:40:33.859604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-14 17:40:33.859619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-14 17:40:33.859633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-14 17:40:33.859647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-14 17:40:33.860943: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-14 17:40:33.862123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-14 17:40:33.862153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-14 17:40:33.862168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-14 17:40:33.862182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-14 17:40:33.862196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-14 17:40:33.862210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-14 17:40:33.862224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-14 17:40:33.862238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-14 17:40:33.863545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-14 17:40:33.863574: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-14 17:40:33.863582: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-14 17:40:33.863590: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-14 17:40:33.864924: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-14 17:40:41.528830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-14 17:40:41.776488: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 3595496 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 19 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 19 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 7658 time to create 1 rle with old method : 0.009368896484375 length of segment : 101 time for calcul the mask position with numpy : 0.0001697540283203125 nb_pixel_total : 3859 time to create 1 rle with old method : 0.004588603973388672 length of segment : 62 time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 12540 time to create 1 rle with old method : 0.01890110969543457 length of segment : 143 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 11227 time to create 1 rle with old method : 0.01346135139465332 length of segment : 169 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 14588 time to create 1 rle with old method : 0.01783442497253418 length of segment : 165 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 3859 time to create 1 rle with old method : 0.0048635005950927734 length of segment : 77 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 4946 time to create 1 rle with old method : 0.006230354309082031 length of segment : 81 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 9746 time to create 1 rle with old method : 0.012035608291625977 length of segment : 138 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 4593 time to create 1 rle with old method : 0.0058443546295166016 length of segment : 69 time for calcul the mask position with numpy : 0.00025153160095214844 nb_pixel_total : 11900 time to create 1 rle with old method : 0.014300346374511719 length of segment : 103 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 4337 time to create 1 rle with old method : 0.0055582523345947266 length of segment : 98 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 2956 time to create 1 rle with old method : 0.0037393569946289062 length of segment : 56 time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 16927 time to create 1 rle with old method : 0.01997661590576172 length of segment : 185 time for calcul the mask position with numpy : 0.0018601417541503906 nb_pixel_total : 116181 time to create 1 rle with old method : 0.1313152313232422 length of segment : 527 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 26203 time to create 1 rle with old method : 0.030865907669067383 length of segment : 318 time for calcul the mask position with numpy : 0.00011920928955078125 nb_pixel_total : 3538 time to create 1 rle with old method : 0.004482746124267578 length of segment : 59 time for calcul the mask position with numpy : 0.012479066848754883 nb_pixel_total : 662653 time to create 1 rle with new method : 0.0612337589263916 length of segment : 1436 time for calcul the mask position with numpy : 0.0003674030303955078 nb_pixel_total : 24770 time to create 1 rle with old method : 0.029254674911499023 length of segment : 175 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 2303 time to create 1 rle with old method : 0.0027413368225097656 length of segment : 66 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 6125 time to create 1 rle with old method : 0.006977558135986328 length of segment : 142 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 6739 time to create 1 rle with old method : 0.007890939712524414 length of segment : 70 time for calcul the mask position with numpy : 0.00021219253540039062 nb_pixel_total : 11184 time to create 1 rle with old method : 0.012640714645385742 length of segment : 144 time for calcul the mask position with numpy : 0.00019502639770507812 nb_pixel_total : 9513 time to create 1 rle with old method : 0.011168956756591797 length of segment : 104 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 15713 time to create 1 rle with old method : 0.017627954483032227 length of segment : 173 time for calcul the mask position with numpy : 0.0001761913299560547 nb_pixel_total : 11008 time to create 1 rle with old method : 0.012825250625610352 length of segment : 100 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 11185 time to create 1 rle with old method : 0.013218879699707031 length of segment : 105 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 7783 time to create 1 rle with old method : 0.009092330932617188 length of segment : 166 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 4357 time to create 1 rle with old method : 0.00522923469543457 length of segment : 48 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 8025 time to create 1 rle with old method : 0.009202241897583008 length of segment : 114 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 3415 time to create 1 rle with old method : 0.004060983657836914 length of segment : 70 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 12901 time to create 1 rle with old method : 0.014799833297729492 length of segment : 139 time for calcul the mask position with numpy : 0.0011532306671142578 nb_pixel_total : 69882 time to create 1 rle with old method : 0.07633328437805176 length of segment : 513 time for calcul the mask position with numpy : 0.00019550323486328125 nb_pixel_total : 12794 time to create 1 rle with old method : 0.01474142074584961 length of segment : 119 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 13964 time to create 1 rle with old method : 0.016317129135131836 length of segment : 123 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 7756 time to create 1 rle with old method : 0.00911259651184082 length of segment : 102 time for calcul the mask position with numpy : 0.0004429817199707031 nb_pixel_total : 25305 time to create 1 rle with old method : 0.027765512466430664 length of segment : 219 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 7480 time to create 1 rle with old method : 0.008653402328491211 length of segment : 90 time for calcul the mask position with numpy : 0.0009143352508544922 nb_pixel_total : 49442 time to create 1 rle with old method : 0.054414987564086914 length of segment : 249 time for calcul the mask position with numpy : 0.00018715858459472656 nb_pixel_total : 9564 time to create 1 rle with old method : 0.010749340057373047 length of segment : 137 time for calcul the mask position with numpy : 0.0014357566833496094 nb_pixel_total : 103298 time to create 1 rle with old method : 0.11106085777282715 length of segment : 518 time for calcul the mask position with numpy : 0.0003960132598876953 nb_pixel_total : 4962 time to create 1 rle with old method : 0.005907535552978516 length of segment : 142 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 2389 time to create 1 rle with old method : 0.0030889511108398438 length of segment : 35 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 9545 time to create 1 rle with old method : 0.01098012924194336 length of segment : 115 time for calcul the mask position with numpy : 0.00040984153747558594 nb_pixel_total : 7252 time to create 1 rle with old method : 0.008582353591918945 length of segment : 172 time spent for convertir_results : 2.3819222450256348 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 44 chid ids of type : 3594 Number RLEs to save : 7937 save missing photos in datou_result : time spend for datou_step_exec : 26.17036747932434 time spend to save output : 0.5103104114532471 total time spend for step 1 : 26.680677890777588 step2:crop_condition Fri Nov 14 17:40:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 19 ! batch 1 Loaded 44 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763138461_3594778 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763294_0.png', 0, 95, 62, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763293_0.png', 0, 114, 101, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763295_0.png', 0, 124, 137, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763296_0.png', 0, 113, 169, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763297_0.png', 0, 158, 148, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763300_0.png', 0, 163, 122, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763298_0.png', 0, 91, 77, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763301_0.png', 0, 91, 69, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763299_0.png', 0, 100, 77, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763303_0.png', 0, 76, 86, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763309_0.png', 0, 1286, 983, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763308_0.png', 0, 102, 58, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763305_0.png', 0, 179, 159, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e_rle_crop_4033763311_0.png', 0, 58, 64, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763313_0.png', 0, 140, 70, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763312_0.png', 0, 68, 142, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763322_0.png', 0, 93, 70, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763315_0.png', 0, 160, 104, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763316_0.png', 0, 170, 155, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422892_b394e9e00e8ba1b3f5a3ad39c2958d0e_rle_crop_4033763326_0.png', 0, 175, 118, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e_rle_crop_4033763327_0.png', 0, 114, 102, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422873_7c181141cb5978eabb40366156e5ef30_rle_crop_4033763330_0.png', 0, 426, 235, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763333_0.png', 0, 71, 141, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763331_0.png', 0, 132, 113, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae_rle_crop_4033763334_0.png', 0, 87, 35, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138467), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422787_27738e7cf84fd066549b22e247c03e5d_rle_crop_4033763336_0.png', 0, 118, 172, 0, 1763138467,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.73719596862793 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763138469_3594778 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138469), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422898_6927b26485ea1f28ced8f6d7878756ed_rle_crop_4033763324_0.png', 0, 292, 498, 0, 1763138469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5665757656097412 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763138470_3594778 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138470), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763320_0.png', 0, 123, 45, 0, 1763138470,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6530134677886963 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763138472_3594778 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763302_0.png', 0, 145, 102, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763306_0.png', 0, 336, 515, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e_rle_crop_4033763310_0.png', 0, 216, 159, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763314_0.png', 0, 99, 144, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763318_0.png', 0, 268, 78, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763321_0.png', 0, 106, 113, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763317_0.png', 0, 168, 77, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763319_0.png', 0, 134, 160, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422895_19434e195253774ddcaab5f604e0ad80_rle_crop_4033763325_0.png', 0, 179, 88, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e_rle_crop_4033763328_0.png', 0, 237, 192, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763332_0.png', 0, 318, 515, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138474), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae_rle_crop_4033763335_0.png', 0, 103, 115, 0, 1763138474,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.887653112411499 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763138476_3594778 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138476), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763304_0.png', 0, 65, 56, 0, 1763138476,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138476), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763307_0.png', 0, 129, 294, 0, 1763138476,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138476), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763323_0.png', 0, 126, 137, 0, 1763138476,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.000135898590088 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763138477_3594778 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763138477), 0.0, 0.0, 14, '', 0, 0, '1763138427_3594778_1394422879_1dc2dd781f135dffb7ff923a56728dbe_rle_crop_4033763329_0.png', 0, 111, 86, 0, 1763138477,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6119425296783447 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1394423493, 1394423457, 1394423422, 1394423251, 1394423215, 1394423182, 1394423151, 1394423118, 1394423082, 1394422898, 1394422895, 1394422892, 1394422891, 1394422879, 1394422873, 1394422799, 1394422797, 1394422792, 1394422787] Looping around the photos to save general results len do output : 44 /1394448898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394448944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423493', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423457', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423422', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423251', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423215', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423182', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423151', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423118', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423082', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422898', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422895', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422892', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422891', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422879', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422873', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422799', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422797', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422792', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422787', None, None, None, None, None, '4049647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 151 time used for this insertion : 0.024887561798095703 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.612890243530273 time spend to save output : 0.026784181594848633 total time spend for step 2 : 20.639674425125122 step3:rle_unique_nms_with_priority Fri Nov 14 17:41:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 44 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 0.8743705749511719 time for calcul the mask position with numpy : 0.07909178733825684 nb_pixel_total : 2023728 time to create 1 rle with new method : 0.09343814849853516 time for calcul the mask position with numpy : 0.006498575210571289 nb_pixel_total : 14588 time to create 1 rle with old method : 0.016968965530395508 time for calcul the mask position with numpy : 0.006219387054443359 nb_pixel_total : 11227 time to create 1 rle with old method : 0.013137102127075195 time for calcul the mask position with numpy : 0.006201744079589844 nb_pixel_total : 12540 time to create 1 rle with old method : 0.013893604278564453 time for calcul the mask position with numpy : 0.006265163421630859 nb_pixel_total : 3859 time to create 1 rle with old method : 0.004287004470825195 time for calcul the mask position with numpy : 0.006197214126586914 nb_pixel_total : 7658 time to create 1 rle with old method : 0.008678913116455078 create new chi : 0.27083492279052734 time to delete rle : 0.017238140106201172 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2360 TO DO : save crop sub photo not yet done ! save time : 0.16812825202941895 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.35187554359436035 time for calcul the mask position with numpy : 0.08029723167419434 nb_pixel_total : 2031263 time to create 1 rle with new method : 0.22816252708435059 time for calcul the mask position with numpy : 0.007407665252685547 nb_pixel_total : 2956 time to create 1 rle with old method : 0.003626585006713867 time for calcul the mask position with numpy : 0.008690118789672852 nb_pixel_total : 4337 time to create 1 rle with old method : 0.005480051040649414 time for calcul the mask position with numpy : 0.007021427154541016 nb_pixel_total : 11900 time to create 1 rle with old method : 0.01412200927734375 time for calcul the mask position with numpy : 0.007195472717285156 nb_pixel_total : 4593 time to create 1 rle with old method : 0.00609278678894043 time for calcul the mask position with numpy : 0.007567644119262695 nb_pixel_total : 9746 time to create 1 rle with old method : 0.012470722198486328 time for calcul the mask position with numpy : 0.007463693618774414 nb_pixel_total : 4946 time to create 1 rle with old method : 0.0062847137451171875 time for calcul the mask position with numpy : 0.006501913070678711 nb_pixel_total : 3859 time to create 1 rle with old method : 0.004848003387451172 create new chi : 0.42539405822753906 time to delete rle : 0.0003876686096191406 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 2324 TO DO : save crop sub photo not yet done ! save time : 0.17852997779846191 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.0835425853729248 time for calcul the mask position with numpy : 0.016156673431396484 nb_pixel_total : 1269941 time to create 1 rle with new method : 0.09679365158081055 time for calcul the mask position with numpy : 0.013102293014526367 nb_pixel_total : 640810 time to create 1 rle with new method : 0.05534696578979492 time for calcul the mask position with numpy : 0.006389617919921875 nb_pixel_total : 3538 time to create 1 rle with old method : 0.0038750171661376953 time for calcul the mask position with numpy : 0.005738973617553711 nb_pixel_total : 26203 time to create 1 rle with old method : 0.0290372371673584 time for calcul the mask position with numpy : 0.006328582763671875 nb_pixel_total : 116181 time to create 1 rle with old method : 0.13391852378845215 time for calcul the mask position with numpy : 0.006392002105712891 nb_pixel_total : 16927 time to create 1 rle with old method : 0.021769285202026367 create new chi : 0.40326857566833496 time to delete rle : 0.0006842613220214844 batch 1 Loaded 11 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6008 TO DO : save crop sub photo not yet done ! save time : 0.38532161712646484 No data in photo_id : 1394423251 No data in photo_id : 1394423215 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.263322114944458 time for calcul the mask position with numpy : 0.08333778381347656 nb_pixel_total : 2046527 time to create 1 rle with new method : 0.10337972640991211 time for calcul the mask position with numpy : 0.006270170211791992 nb_pixel_total : 2303 time to create 1 rle with old method : 0.002710580825805664 time for calcul the mask position with numpy : 0.006676673889160156 nb_pixel_total : 24770 time to create 1 rle with old method : 0.028308629989624023 create new chi : 0.24265384674072266 time to delete rle : 0.000247955322265625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1562 TO DO : save crop sub photo not yet done ! save time : 0.1303694248199463 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.11943674087524414 time for calcul the mask position with numpy : 0.08891463279724121 nb_pixel_total : 2049552 time to create 1 rle with new method : 0.12831950187683105 time for calcul the mask position with numpy : 0.006440401077270508 nb_pixel_total : 11184 time to create 1 rle with old method : 0.013404607772827148 time for calcul the mask position with numpy : 0.006483554840087891 nb_pixel_total : 6739 time to create 1 rle with old method : 0.00794529914855957 time for calcul the mask position with numpy : 0.006434440612792969 nb_pixel_total : 6125 time to create 1 rle with old method : 0.009506940841674805 create new chi : 0.2785036563873291 time to delete rle : 0.0004336833953857422 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1792 TO DO : save crop sub photo not yet done ! save time : 0.1444556713104248 No data in photo_id : 1394423118 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 0.4400184154510498 time for calcul the mask position with numpy : 0.12572717666625977 nb_pixel_total : 1996895 time to create 1 rle with new method : 0.16945457458496094 time for calcul the mask position with numpy : 0.006894826889038086 nb_pixel_total : 12901 time to create 1 rle with old method : 0.02110123634338379 time for calcul the mask position with numpy : 0.006656169891357422 nb_pixel_total : 688 time to create 1 rle with old method : 0.0012161731719970703 time for calcul the mask position with numpy : 0.0072247982025146484 nb_pixel_total : 8025 time to create 1 rle with old method : 0.013082027435302734 time for calcul the mask position with numpy : 0.00660252571105957 nb_pixel_total : 300 time to create 1 rle with old method : 0.0005204677581787109 time for calcul the mask position with numpy : 0.006636381149291992 nb_pixel_total : 7372 time to create 1 rle with old method : 0.009192705154418945 time for calcul the mask position with numpy : 0.006221294403076172 nb_pixel_total : 11185 time to create 1 rle with old method : 0.013718605041503906 time for calcul the mask position with numpy : 0.006709575653076172 nb_pixel_total : 11008 time to create 1 rle with old method : 0.018054485321044922 time for calcul the mask position with numpy : 0.006787538528442383 nb_pixel_total : 15713 time to create 1 rle with old method : 0.026015520095825195 time for calcul the mask position with numpy : 0.006819248199462891 nb_pixel_total : 9513 time to create 1 rle with old method : 0.013422250747680664 create new chi : 0.4861440658569336 time to delete rle : 0.0007908344268798828 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 2945 TO DO : save crop sub photo not yet done ! save time : 0.20896267890930176 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03499937057495117 time for calcul the mask position with numpy : 0.020569801330566406 nb_pixel_total : 2003718 time to create 1 rle with new method : 0.032833099365234375 time for calcul the mask position with numpy : 0.008434295654296875 nb_pixel_total : 69882 time to create 1 rle with old method : 0.08716607093811035 create new chi : 0.15842175483703613 time to delete rle : 0.0003173351287841797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2106 TO DO : save crop sub photo not yet done ! save time : 0.1566758155822754 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032027244567871094 time for calcul the mask position with numpy : 0.020157575607299805 nb_pixel_total : 2060806 time to create 1 rle with new method : 0.02960062026977539 time for calcul the mask position with numpy : 0.006716728210449219 nb_pixel_total : 12794 time to create 1 rle with old method : 0.016463041305541992 create new chi : 0.08550691604614258 time to delete rle : 0.00031304359436035156 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 1318 TO DO : save crop sub photo not yet done ! save time : 0.12044095993041992 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03434562683105469 time for calcul the mask position with numpy : 0.09620451927185059 nb_pixel_total : 2059636 time to create 1 rle with new method : 0.1028909683227539 time for calcul the mask position with numpy : 0.006383657455444336 nb_pixel_total : 13964 time to create 1 rle with old method : 0.01641702651977539 create new chi : 0.23319315910339355 time to delete rle : 0.0002276897430419922 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1326 TO DO : save crop sub photo not yet done ! save time : 0.1155085563659668 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11615490913391113 time for calcul the mask position with numpy : 0.10958480834960938 nb_pixel_total : 2040539 time to create 1 rle with new method : 0.1355299949645996 time for calcul the mask position with numpy : 0.007090330123901367 nb_pixel_total : 25305 time to create 1 rle with old method : 0.030404090881347656 time for calcul the mask position with numpy : 0.007546663284301758 nb_pixel_total : 7756 time to create 1 rle with old method : 0.012890100479125977 create new chi : 0.31693291664123535 time to delete rle : 0.0003998279571533203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1722 TO DO : save crop sub photo not yet done ! save time : 0.1454486846923828 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04566836357116699 time for calcul the mask position with numpy : 0.16639447212219238 nb_pixel_total : 2066120 time to create 1 rle with new method : 0.16459918022155762 time for calcul the mask position with numpy : 0.006857633590698242 nb_pixel_total : 7480 time to create 1 rle with old method : 0.008791923522949219 create new chi : 0.3584010601043701 time to delete rle : 0.0002467632293701172 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1260 TO DO : save crop sub photo not yet done ! save time : 0.10915732383728027 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035614728927612305 time for calcul the mask position with numpy : 0.12319159507751465 nb_pixel_total : 2024158 time to create 1 rle with new method : 0.08792376518249512 time for calcul the mask position with numpy : 0.006629228591918945 nb_pixel_total : 49442 time to create 1 rle with old method : 0.057747840881347656 create new chi : 0.2867701053619385 time to delete rle : 0.00033092498779296875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1578 TO DO : save crop sub photo not yet done ! save time : 0.13578510284423828 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.20565581321716309 time for calcul the mask position with numpy : 0.09606528282165527 nb_pixel_total : 1955776 time to create 1 rle with new method : 0.10838961601257324 time for calcul the mask position with numpy : 0.0059549808502197266 nb_pixel_total : 4962 time to create 1 rle with old method : 0.005580902099609375 time for calcul the mask position with numpy : 0.00616455078125 nb_pixel_total : 103298 time to create 1 rle with old method : 0.11143207550048828 time for calcul the mask position with numpy : 0.005869150161743164 nb_pixel_total : 9564 time to create 1 rle with old method : 0.010363101959228516 create new chi : 0.3601655960083008 time to delete rle : 0.0004267692565917969 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 2674 TO DO : save crop sub photo not yet done ! save time : 0.2029867172241211 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04260897636413574 time for calcul the mask position with numpy : 0.0722196102142334 nb_pixel_total : 2061666 time to create 1 rle with new method : 0.130723237991333 time for calcul the mask position with numpy : 0.011479377746582031 nb_pixel_total : 9545 time to create 1 rle with old method : 0.011083841323852539 time for calcul the mask position with numpy : 0.0069887638092041016 nb_pixel_total : 2389 time to create 1 rle with old method : 0.002912282943725586 create new chi : 0.24587178230285645 time to delete rle : 0.0003075599670410156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1380 TO DO : save crop sub photo not yet done ! save time : 0.12281966209411621 No data in photo_id : 1394422792 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06731534004211426 time for calcul the mask position with numpy : 0.02025437355041504 nb_pixel_total : 2066348 time to create 1 rle with new method : 0.42952585220336914 time for calcul the mask position with numpy : 0.0063703060150146484 nb_pixel_total : 7252 time to create 1 rle with old method : 0.008405923843383789 create new chi : 0.4781017303466797 time to delete rle : 0.0002334117889404297 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1424 TO DO : save crop sub photo not yet done ! save time : 0.12226176261901855 map_output_result : {1394423493: (0.0, 'Should be the crop_list due to order', 0), 1394423457: (0.0, 'Should be the crop_list due to order', 0), 1394423422: (0.0, 'Should be the crop_list due to order', 0), 1394423251: (0.0, 'Should be the crop_list due to order', 0.0), 1394423215: (0.0, 'Should be the crop_list due to order', 0.0), 1394423182: (0.0, 'Should be the crop_list due to order', 0), 1394423151: (0.0, 'Should be the crop_list due to order', 0), 1394423118: (0.0, 'Should be the crop_list due to order', 0.0), 1394423082: (0.0, 'Should be the crop_list due to order', 0), 1394422898: (0.0, 'Should be the crop_list due to order', 0), 1394422895: (0.0, 'Should be the crop_list due to order', 0), 1394422892: (0.0, 'Should be the crop_list due to order', 0), 1394422891: (0.0, 'Should be the crop_list due to order', 0), 1394422879: (0.0, 'Should be the crop_list due to order', 0), 1394422873: (0.0, 'Should be the crop_list due to order', 0), 1394422799: (0.0, 'Should be the crop_list due to order', 0), 1394422797: (0.0, 'Should be the crop_list due to order', 0), 1394422792: (0.0, 'Should be the crop_list due to order', 0.0), 1394422787: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1394423493, 1394423457, 1394423422, 1394423251, 1394423215, 1394423182, 1394423151, 1394423118, 1394423082, 1394422898, 1394422895, 1394422892, 1394422891, 1394422879, 1394422873, 1394422799, 1394422797, 1394422792, 1394422787] Looping around the photos to save general results len do output : 19 /1394423493.Didn't retrieve data . /1394423457.Didn't retrieve data . /1394423422.Didn't retrieve data . /1394423251.Didn't retrieve data . /1394423215.Didn't retrieve data . /1394423182.Didn't retrieve data . /1394423151.Didn't retrieve data . /1394423118.Didn't retrieve data . /1394423082.Didn't retrieve data . /1394422898.Didn't retrieve data . /1394422895.Didn't retrieve data . /1394422892.Didn't retrieve data . /1394422891.Didn't retrieve data . /1394422879.Didn't retrieve data . /1394422873.Didn't retrieve data . /1394422799.Didn't retrieve data . /1394422797.Didn't retrieve data . /1394422792.Didn't retrieve data . /1394422787.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423493', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423457', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423422', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423251', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423215', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423182', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423151', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423118', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423082', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422898', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422895', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422892', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422891', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422879', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422873', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422799', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422797', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422792', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422787', None, None, None, None, None, '4049647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.014817953109741211 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.323224067687988 time spend to save output : 0.015363693237304688 total time spend for step 3 : 10.338587760925293 step4:ventilate_hashtags_in_portfolio Fri Nov 14 17:41:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28540305 get user id for portfolio 28540305 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28540305 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','flou','autre','papier','background','metal','environnement','pet_fonce','pehd','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28540305 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','flou','autre','papier','background','metal','environnement','pet_fonce','pehd','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28540305 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','flou','autre','papier','background','metal','environnement','pet_fonce','pehd','pet_clair','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28540475,28540476,28540477,28540478,28540479,28540480,28540481,28540482,28540483,28540484,28540485?tags=carton,flou,autre,papier,background,metal,environnement,pet_fonce,pehd,pet_clair,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1394423493, 1394423457, 1394423422, 1394423251, 1394423215, 1394423182, 1394423151, 1394423118, 1394423082, 1394422898, 1394422895, 1394422892, 1394422891, 1394422879, 1394422873, 1394422799, 1394422797, 1394422792, 1394422787] Looping around the photos to save general results len do output : 1 /28540305. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423493', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423457', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423422', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423251', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423215', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423182', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423151', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423118', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423082', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422898', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422895', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422892', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422891', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422879', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422873', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422799', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422797', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422792', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422787', None, None, None, None, None, '4049647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015848398208618164 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7952024936676025 time spend to save output : 0.016150951385498047 total time spend for step 4 : 1.8113534450531006 step5:final Fri Nov 14 17:41:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1394423493: ('0.03419750548245615',), 1394423457: ('0.03419750548245615',), 1394423422: ('0.03419750548245615',), 1394423251: ('0.03419750548245615',), 1394423215: ('0.03419750548245615',), 1394423182: ('0.03419750548245615',), 1394423151: ('0.03419750548245615',), 1394423118: ('0.03419750548245615',), 1394423082: ('0.03419750548245615',), 1394422898: ('0.03419750548245615',), 1394422895: ('0.03419750548245615',), 1394422892: ('0.03419750548245615',), 1394422891: ('0.03419750548245615',), 1394422879: ('0.03419750548245615',), 1394422873: ('0.03419750548245615',), 1394422799: ('0.03419750548245615',), 1394422797: ('0.03419750548245615',), 1394422792: ('0.03419750548245615',), 1394422787: ('0.03419750548245615',)} new output for save of step final : {1394423493: ('0.03419750548245615',), 1394423457: ('0.03419750548245615',), 1394423422: ('0.03419750548245615',), 1394423251: ('0.03419750548245615',), 1394423215: ('0.03419750548245615',), 1394423182: ('0.03419750548245615',), 1394423151: ('0.03419750548245615',), 1394423118: ('0.03419750548245615',), 1394423082: ('0.03419750548245615',), 1394422898: ('0.03419750548245615',), 1394422895: ('0.03419750548245615',), 1394422892: ('0.03419750548245615',), 1394422891: ('0.03419750548245615',), 1394422879: ('0.03419750548245615',), 1394422873: ('0.03419750548245615',), 1394422799: ('0.03419750548245615',), 1394422797: ('0.03419750548245615',), 1394422792: ('0.03419750548245615',), 1394422787: ('0.03419750548245615',)} [1394423493, 1394423457, 1394423422, 1394423251, 1394423215, 1394423182, 1394423151, 1394423118, 1394423082, 1394422898, 1394422895, 1394422892, 1394422891, 1394422879, 1394422873, 1394422799, 1394422797, 1394422792, 1394422787] Looping around the photos to save general results len do output : 19 /1394423493.Didn't retrieve data . /1394423457.Didn't retrieve data . /1394423422.Didn't retrieve data . /1394423251.Didn't retrieve data . /1394423215.Didn't retrieve data . /1394423182.Didn't retrieve data . /1394423151.Didn't retrieve data . /1394423118.Didn't retrieve data . /1394423082.Didn't retrieve data . /1394422898.Didn't retrieve data . /1394422895.Didn't retrieve data . /1394422892.Didn't retrieve data . /1394422891.Didn't retrieve data . /1394422879.Didn't retrieve data . /1394422873.Didn't retrieve data . /1394422799.Didn't retrieve data . /1394422797.Didn't retrieve data . /1394422792.Didn't retrieve data . /1394422787.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423493', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423457', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423422', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423251', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423215', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423182', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423151', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423118', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423082', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422898', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422895', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422892', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422891', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422879', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422873', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422799', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422797', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422792', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422787', None, None, None, None, None, '4049647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 57 time used for this insertion : 0.015738248825073242 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15046977996826172 time spend to save output : 0.016714811325073242 total time spend for step 5 : 0.16718459129333496 step6:blur_detection Fri Nov 14 17:41:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d.jpg resize: (1080, 1920) 1394423493 0.7509497711188657 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb.jpg resize: (1080, 1920) 1394423457 -0.5807542838740609 treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc.jpg resize: (1080, 1920) 1394423422 0.6679064874351716 treat image : temp/1763138427_3594778_1394423251_b205409f0595494cfe747d4ca84d54cf.jpg resize: (1080, 1920) 1394423251 -0.7997239348224469 treat image : temp/1763138427_3594778_1394423215_837de84f14e47344c958198cbb98777f.jpg resize: (1080, 1920) 1394423215 -0.31663888391091716 treat image : temp/1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e.jpg resize: (1080, 1920) 1394423182 -0.6632818052184362 treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e.jpg resize: (1080, 1920) 1394423151 -0.7387949845666582 treat image : temp/1763138427_3594778_1394423118_1ba1b082c3ba63fdde2b2aa8281b0274.jpg resize: (1080, 1920) 1394423118 -0.9640758730907258 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9.jpg resize: (1080, 1920) 1394423082 -3.591387631303938 treat image : temp/1763138427_3594778_1394422898_6927b26485ea1f28ced8f6d7878756ed.jpg resize: (1080, 1920) 1394422898 1.2647045637418473 treat image : temp/1763138427_3594778_1394422895_19434e195253774ddcaab5f604e0ad80.jpg resize: (1080, 1920) 1394422895 0.03380168028750778 treat image : temp/1763138427_3594778_1394422892_b394e9e00e8ba1b3f5a3ad39c2958d0e.jpg resize: (1080, 1920) 1394422892 -0.49642175779891495 treat image : temp/1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e.jpg resize: (1080, 1920) 1394422891 0.7526821056550309 treat image : temp/1763138427_3594778_1394422879_1dc2dd781f135dffb7ff923a56728dbe.jpg resize: (1080, 1920) 1394422879 -0.02207238035771078 treat image : temp/1763138427_3594778_1394422873_7c181141cb5978eabb40366156e5ef30.jpg resize: (1080, 1920) 1394422873 -0.971041862821145 treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7.jpg resize: (1080, 1920) 1394422799 4.490536291203512 treat image : temp/1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae.jpg resize: (1080, 1920) 1394422797 0.9018665531950074 treat image : temp/1763138427_3594778_1394422792_c7b2288701fdded02893632f8620d4b0.jpg resize: (1080, 1920) 1394422792 -0.26474267851140454 treat image : temp/1763138427_3594778_1394422787_27738e7cf84fd066549b22e247c03e5d.jpg resize: (1080, 1920) 1394422787 -0.009132009374477229 treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763294_0.png resize: (62, 95) 1394448898 -0.20499677077787967 treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763293_0.png resize: (101, 114) 1394448899 -0.25878020294303183 treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763295_0.png resize: (137, 124) 1394448900 -0.741472987927817 treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763296_0.png resize: (169, 113) 1394448901 -1.584894231959651 treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763297_0.png resize: (148, 158) 1394448902 -1.3813776998571852 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763300_0.png resize: (122, 163) 1394448903 -2.694659789636218 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763298_0.png resize: (77, 91) 1394448904 -1.469427922292257 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763301_0.png resize: (69, 91) 1394448905 -0.35592045719429477 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763299_0.png resize: (77, 100) 1394448906 0.6805686704793876 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763303_0.png resize: (86, 76) 1394448907 -2.3365488826074317 treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763309_0.png resize: (983, 1286) 1394448908 -1.0418399282923294 treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763308_0.png resize: (58, 102) 1394448909 -3.500881897833611 treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763305_0.png resize: (159, 179) 1394448910 -1.9639351171075958 treat image : temp/1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e_rle_crop_4033763311_0.png resize: (64, 58) 1394448911 -0.7700352587881354 treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763313_0.png resize: (70, 140) 1394448912 -2.53048703384187 treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763312_0.png resize: (142, 68) 1394448913 1.8231111055723672 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763322_0.png resize: (70, 93) 1394448914 -2.51959844767303 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763315_0.png resize: (104, 160) 1394448915 -1.462890715660667 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763316_0.png resize: (155, 170) 1394448916 -1.4940969674572218 treat image : temp/1763138427_3594778_1394422892_b394e9e00e8ba1b3f5a3ad39c2958d0e_rle_crop_4033763326_0.png resize: (118, 175) 1394448917 -1.8570806078078217 treat image : temp/1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e_rle_crop_4033763327_0.png resize: (102, 114) 1394448918 0.5716590756674903 treat image : temp/1763138427_3594778_1394422873_7c181141cb5978eabb40366156e5ef30_rle_crop_4033763330_0.png resize: (235, 426) 1394448919 -1.3203918530164171 treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763333_0.png resize: (141, 71) 1394448920 -1.088150993014156 treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763331_0.png resize: (113, 132) 1394448921 -2.045323399366015 treat image : temp/1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae_rle_crop_4033763334_0.png resize: (35, 87) 1394448922 1.4887874873145792 treat image : temp/1763138427_3594778_1394422787_27738e7cf84fd066549b22e247c03e5d_rle_crop_4033763336_0.png resize: (172, 118) 1394448923 -2.257963371337877 treat image : temp/1763138427_3594778_1394422898_6927b26485ea1f28ced8f6d7878756ed_rle_crop_4033763324_0.png resize: (498, 292) 1394448924 -0.6032471836048979 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763320_0.png resize: (45, 123) 1394448926 -1.2755835436404286 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763302_0.png resize: (102, 145) 1394448928 -0.5537865741279396 treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763306_0.png resize: (515, 336) 1394448929 0.14294228616660407 treat image : temp/1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e_rle_crop_4033763310_0.png resize: (159, 216) 1394448930 -0.9632180182415051 treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763314_0.png resize: (144, 99) 1394448931 -1.8906481567879647 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763318_0.png resize: (78, 268) 1394448932 -2.164428569135855 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763321_0.png resize: (113, 106) 1394448933 -2.705847831356929 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763317_0.png resize: (77, 168) 1394448934 -0.1409881519291688 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763319_0.png resize: (160, 134) 1394448935 -1.873401301903457 treat image : temp/1763138427_3594778_1394422895_19434e195253774ddcaab5f604e0ad80_rle_crop_4033763325_0.png resize: (88, 179) 1394448936 -1.7646750388304144 treat image : temp/1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e_rle_crop_4033763328_0.png resize: (192, 237) 1394448937 -0.8306044728168552 treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763332_0.png resize: (515, 318) 1394448938 0.3235544515556227 treat image : temp/1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae_rle_crop_4033763335_0.png resize: (115, 103) 1394448939 -1.3702859010137352 treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763304_0.png resize: (56, 65) 1394448941 -0.6951200180014034 treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763307_0.png resize: (294, 129) 1394448942 -1.1346786573913552 treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763323_0.png resize: (137, 126) 1394448943 -0.07639183927310855 treat image : temp/1763138427_3594778_1394422879_1dc2dd781f135dffb7ff923a56728dbe_rle_crop_4033763329_0.png resize: (86, 111) 1394448944 1.6089688055819347 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 63 time used for this insertion : 0.01335597038269043 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 63 time used for this insertion : 0.015626907348632812 save missing photos in datou_result : time spend for datou_step_exec : 15.468721866607666 time spend to save output : 0.033687591552734375 total time spend for step 6 : 15.5024094581604 step7:brightness Fri Nov 14 17:41:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d.jpg treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb.jpg treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc.jpg treat image : temp/1763138427_3594778_1394423251_b205409f0595494cfe747d4ca84d54cf.jpg treat image : temp/1763138427_3594778_1394423215_837de84f14e47344c958198cbb98777f.jpg treat image : temp/1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e.jpg treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e.jpg treat image : temp/1763138427_3594778_1394423118_1ba1b082c3ba63fdde2b2aa8281b0274.jpg treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9.jpg treat image : temp/1763138427_3594778_1394422898_6927b26485ea1f28ced8f6d7878756ed.jpg treat image : temp/1763138427_3594778_1394422895_19434e195253774ddcaab5f604e0ad80.jpg treat image : temp/1763138427_3594778_1394422892_b394e9e00e8ba1b3f5a3ad39c2958d0e.jpg treat image : temp/1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e.jpg treat image : temp/1763138427_3594778_1394422879_1dc2dd781f135dffb7ff923a56728dbe.jpg treat image : temp/1763138427_3594778_1394422873_7c181141cb5978eabb40366156e5ef30.jpg treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7.jpg treat image : temp/1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae.jpg treat image : temp/1763138427_3594778_1394422792_c7b2288701fdded02893632f8620d4b0.jpg treat image : temp/1763138427_3594778_1394422787_27738e7cf84fd066549b22e247c03e5d.jpg treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763294_0.png treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763293_0.png treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763295_0.png treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763296_0.png treat image : temp/1763138427_3594778_1394423493_5a11446828101a92b786d6baede4f16d_rle_crop_4033763297_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763300_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763298_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763301_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763299_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763303_0.png treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763309_0.png treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763308_0.png treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763305_0.png treat image : temp/1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e_rle_crop_4033763311_0.png treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763313_0.png treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763312_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763322_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763315_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763316_0.png treat image : temp/1763138427_3594778_1394422892_b394e9e00e8ba1b3f5a3ad39c2958d0e_rle_crop_4033763326_0.png treat image : temp/1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e_rle_crop_4033763327_0.png treat image : temp/1763138427_3594778_1394422873_7c181141cb5978eabb40366156e5ef30_rle_crop_4033763330_0.png treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763333_0.png treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763331_0.png treat image : temp/1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae_rle_crop_4033763334_0.png treat image : temp/1763138427_3594778_1394422787_27738e7cf84fd066549b22e247c03e5d_rle_crop_4033763336_0.png treat image : temp/1763138427_3594778_1394422898_6927b26485ea1f28ced8f6d7878756ed_rle_crop_4033763324_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763320_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763302_0.png treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763306_0.png treat image : temp/1763138427_3594778_1394423182_bab4613b6b695dcd076356408c95075e_rle_crop_4033763310_0.png treat image : temp/1763138427_3594778_1394423151_80f9f568045fba717ea444f7a836a17e_rle_crop_4033763314_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763318_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763321_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763317_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763319_0.png treat image : temp/1763138427_3594778_1394422895_19434e195253774ddcaab5f604e0ad80_rle_crop_4033763325_0.png treat image : temp/1763138427_3594778_1394422891_e1eb3e4994006cdff4f15a8888e8427e_rle_crop_4033763328_0.png treat image : temp/1763138427_3594778_1394422799_1fc51bd1835a71c808b5ae9f08d3efc7_rle_crop_4033763332_0.png treat image : temp/1763138427_3594778_1394422797_ebfdda033236ff10012636a39ee320ae_rle_crop_4033763335_0.png treat image : temp/1763138427_3594778_1394423457_e98914fd45f7e8867784964740059afb_rle_crop_4033763304_0.png treat image : temp/1763138427_3594778_1394423422_57de60ffe5aa248d31ad86fe734236fc_rle_crop_4033763307_0.png treat image : temp/1763138427_3594778_1394423082_b0d9e6cfd0ecdabec841638c13eba0f9_rle_crop_4033763323_0.png treat image : temp/1763138427_3594778_1394422879_1dc2dd781f135dffb7ff923a56728dbe_rle_crop_4033763329_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 63 time used for this insertion : 0.014769315719604492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 63 time used for this insertion : 0.014733076095581055 save missing photos in datou_result : time spend for datou_step_exec : 4.505163192749023 time spend to save output : 0.03385758399963379 total time spend for step 7 : 4.539020776748657 step8:velours_tree Fri Nov 14 17:41:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.16940641403198242 time spend to save output : 3.6716461181640625e-05 total time spend for step 8 : 0.16944313049316406 step9:send_mail_cod Fri Nov 14 17:41:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28540305_14-11-2025_17_41_50.pdf 28540475 change filename to text .imagette285404751763138510 28540476 imagette285404761763138510 28540477 change filename to text .change filename to text .change filename to text .imagette285404771763138510 28540478 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette285404781763138510 28540479 imagette285404791763138512 28540480 change filename to text .imagette285404801763138512 28540482 imagette285404821763138512 28540483 change filename to text .imagette285404831763138512 28540484 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette285404841763138512 28540485 imagette285404851763138513 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28540305 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28540475,28540476,28540477,28540478,28540479,28540480,28540481,28540482,28540483,28540484,28540485?tags=carton,flou,autre,papier,background,metal,environnement,pet_fonce,pehd,pet_clair,mal_croppe args[1394423493] : ((1394423493, 0.7509497711188657, 492688767), (1394423493, 0.5512420047240196, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423457] : ((1394423457, -0.5807542838740609, 492688767), (1394423457, 0.4973823114162564, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423422] : ((1394423422, 0.6679064874351716, 492688767), (1394423422, 0.4295331102514583, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423251] : ((1394423251, -0.7997239348224469, 492688767), (1394423251, 1.0015442071782301, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423215] : ((1394423215, -0.31663888391091716, 492688767), (1394423215, 0.728295355594915, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423182] : ((1394423182, -0.6632818052184362, 492688767), (1394423182, 0.7244283486583476, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423151] : ((1394423151, -0.7387949845666582, 492688767), (1394423151, 0.8927417044128028, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423118] : ((1394423118, -0.9640758730907258, 492688767), (1394423118, 0.8554600435669891, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394423082] : ((1394423082, -3.591387631303938, 492609224), (1394423082, 0.47862522760509824, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422898] : ((1394422898, 1.2647045637418473, 492688767), (1394422898, 0.6603587731032088, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422895] : ((1394422895, 0.03380168028750778, 492688767), (1394422895, 0.695818473818366, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422892] : ((1394422892, -0.49642175779891495, 492688767), (1394422892, 0.5756192547961406, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422891] : ((1394422891, 0.7526821056550309, 492688767), (1394422891, 0.8080686279965398, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422879] : ((1394422879, -0.02207238035771078, 492688767), (1394422879, 0.6653072634068794, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422873] : ((1394422873, -0.971041862821145, 492688767), (1394422873, 0.7426581899171549, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422799] : ((1394422799, 4.490536291203512, 492688767), (1394422799, 0.4114677750942847, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422797] : ((1394422797, 0.9018665531950074, 492688767), (1394422797, 0.6902742361205554, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422792] : ((1394422792, -0.26474267851140454, 492688767), (1394422792, 1.2047976450749769, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com args[1394422787] : ((1394422787, -0.009132009374477229, 492688767), (1394422787, 0.6657301591405829, 2107752395), '0.03419750548245615') We are sending mail with results at report@fotonower.com refus_total : 0.03419750548245615 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28540305 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28540305_14-11-2025_17_41_50.pdf results_Auto_P28540305_14-11-2025_17_41_50.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28540305_14-11-2025_17_41_50.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28540305','results_Auto_P28540305_14-11-2025_17_41_50.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28540305_14-11-2025_17_41_50.pdf','pdf','','0.29','0.03419750548245615') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28540305

https://www.fotonower.com/image?json=false&list_photos_id=1394423493
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423457
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423422
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423251
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423215
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423182
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423151
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423118
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394423082
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422898
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2647045637418473)
https://www.fotonower.com/image?json=false&list_photos_id=1394422895
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422892
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422891
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422879
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422873
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422799
La photo est trop floue, merci de reprendre une photo.(avec le score = 4.490536291203512)
https://www.fotonower.com/image?json=false&list_photos_id=1394422797
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422792
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394422787
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 3.42%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28540475?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28540477?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28540478?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28540480?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/28540483?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28540484?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28540305_14-11-2025_17_41_50.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28540475,28540476,28540477,28540478,28540479,28540480,28540481,28540482,28540483,28540484,28540485?tags=carton,flou,autre,papier,background,metal,environnement,pet_fonce,pehd,pet_clair,mal_croppe.


L'équipe Fotonower 202 b'' Date: Fri, 14 Nov 2025 16:41:55 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: SkRbj-y6SDWixzU7a_oH7g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1394423493, 1394423457, 1394423422, 1394423251, 1394423215, 1394423182, 1394423151, 1394423118, 1394423082, 1394422898, 1394422895, 1394422892, 1394422891, 1394422879, 1394422873, 1394422799, 1394422797, 1394422792, 1394422787] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423493', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423457', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423422', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423251', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423215', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423182', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423151', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423118', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423082', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422898', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422895', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422892', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422891', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422879', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422873', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422799', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422797', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422792', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422787', None, None, None, None, None, '4049647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.015119075775146484 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.031235694885254 time spend to save output : 0.015377998352050781 total time spend for step 9 : 5.046613693237305 step10:split_time_score Fri Nov 14 17:41:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 19),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14112025 28540305 Nombre de photos uploadées : 19 / 23040 (0%) 14112025 28540305 Nombre de photos taguées (types de déchets): 0 / 19 (0%) 14112025 28540305 Nombre de photos taguées (volume) : 0 / 19 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ??????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009741783142089844 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20685529708862305 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1126048900462963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28518833_14-11-2025_08_12_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28518833 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28518833 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540270 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540271 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540286 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540287 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540298 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540301 order by id desc limit 1 Qualite : 0.03419750548245615 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28540305_14-11-2025_17_41_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28540305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28540305 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14112025': {'nb_upload': 19, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1394423493, 1394423457, 1394423422, 1394423251, 1394423215, 1394423182, 1394423151, 1394423118, 1394423082, 1394422898, 1394422895, 1394422892, 1394422891, 1394422879, 1394422873, 1394422799, 1394422797, 1394422792, 1394422787] Looping around the photos to save general results len do output : 1 /28540305Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423493', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423457', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423422', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423251', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423215', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423182', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423151', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423118', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394423082', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422898', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422895', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422892', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422891', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422879', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422873', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422799', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422797', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422792', None, None, None, None, None, '4049647') ('3318', None, None, None, None, None, None, None, '4049647') ('3318', '28540305', '1394422787', None, None, None, None, None, '4049647') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.014793872833251953 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.066023349761963 time spend to save output : 0.015040397644042969 total time spend for step 10 : 10.081063747406006 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 19 set_done_treatment 50.77user 22.03system 1:40.32elapsed 72%CPU (0avgtext+0avgdata 2933036maxresident)k 631784inputs+19368outputs (2286major+1823006minor)pagefaults 0swaps