python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 642033 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3965023'] with mtr_portfolio_ids : ['27944829'] and first list_photo_ids : [] new path : /proc/642033/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 16 ; length of list_pids : 16 ; length of list_args : 16 time to download the photos : 2.08842396736145 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Oct 30 09:10:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-30 09:10:35.158893: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-30 09:10:35.186497: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-30 09:10:35.188644: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3e2c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-30 09:10:35.188699: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-30 09:10:35.192530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-30 09:10:35.330439: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1654d1e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-30 09:10:35.330492: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-30 09:10:35.331880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-30 09:10:35.332284: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-30 09:10:35.335300: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-30 09:10:35.338180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-30 09:10:35.338691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-30 09:10:35.341871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-30 09:10:35.343521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-30 09:10:35.348911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-30 09:10:35.350394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-30 09:10:35.350469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-30 09:10:35.351217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-30 09:10:35.351232: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-30 09:10:35.351241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-30 09:10:35.352547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-30 09:10:35.601659: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-30 09:10:35.601792: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-30 09:10:35.601816: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-30 09:10:35.601838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-30 09:10:35.601859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-30 09:10:35.601879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-30 09:10:35.601899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-30 09:10:35.601920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-30 09:10:35.603488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-30 09:10:35.604901: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-30 09:10:35.604943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-30 09:10:35.604962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-30 09:10:35.604979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-30 09:10:35.604995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-30 09:10:35.605012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-30 09:10:35.605029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-30 09:10:35.605046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-30 09:10:35.606611: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-30 09:10:35.606652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-30 09:10:35.606662: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-30 09:10:35.606672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-30 09:10:35.608079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-30 09:10:43.077141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-30 09:10:43.271427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 642713 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 16 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 16 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0004761219024658203 nb_pixel_total : 16410 time to create 1 rle with old method : 0.019056081771850586 length of segment : 218 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 9051 time to create 1 rle with old method : 0.009707927703857422 length of segment : 160 time for calcul the mask position with numpy : 0.0001850128173828125 nb_pixel_total : 8728 time to create 1 rle with old method : 0.009456634521484375 length of segment : 152 time for calcul the mask position with numpy : 0.0003292560577392578 nb_pixel_total : 11448 time to create 1 rle with old method : 0.012089014053344727 length of segment : 241 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 3834 time to create 1 rle with old method : 0.004272937774658203 length of segment : 49 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 4927 time to create 1 rle with old method : 0.005543708801269531 length of segment : 68 time for calcul the mask position with numpy : 0.00014352798461914062 nb_pixel_total : 7033 time to create 1 rle with old method : 0.008054018020629883 length of segment : 75 time for calcul the mask position with numpy : 0.00012826919555664062 nb_pixel_total : 6311 time to create 1 rle with old method : 0.007035732269287109 length of segment : 114 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 12077 time to create 1 rle with old method : 0.013273000717163086 length of segment : 169 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 4820 time to create 1 rle with old method : 0.005453586578369141 length of segment : 143 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 4437 time to create 1 rle with old method : 0.00518035888671875 length of segment : 80 time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 15411 time to create 1 rle with old method : 0.016865015029907227 length of segment : 183 time for calcul the mask position with numpy : 0.0008904933929443359 nb_pixel_total : 56243 time to create 1 rle with old method : 0.05815243721008301 length of segment : 266 time for calcul the mask position with numpy : 0.00019884109497070312 nb_pixel_total : 10288 time to create 1 rle with old method : 0.011207342147827148 length of segment : 120 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 8321 time to create 1 rle with old method : 0.009106636047363281 length of segment : 138 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 6749 time to create 1 rle with old method : 0.007330417633056641 length of segment : 90 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 8629 time to create 1 rle with old method : 0.009211301803588867 length of segment : 164 time for calcul the mask position with numpy : 0.0001461505889892578 nb_pixel_total : 8881 time to create 1 rle with old method : 0.00981593132019043 length of segment : 76 time for calcul the mask position with numpy : 0.00052642822265625 nb_pixel_total : 35327 time to create 1 rle with old method : 0.04056406021118164 length of segment : 320 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 6895 time to create 1 rle with old method : 0.007670402526855469 length of segment : 74 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 10818 time to create 1 rle with old method : 0.011857271194458008 length of segment : 163 time for calcul the mask position with numpy : 0.00027298927307128906 nb_pixel_total : 11551 time to create 1 rle with old method : 0.012803316116333008 length of segment : 108 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 11058 time to create 1 rle with old method : 0.011816024780273438 length of segment : 206 time for calcul the mask position with numpy : 0.00016880035400390625 nb_pixel_total : 9433 time to create 1 rle with old method : 0.010418176651000977 length of segment : 121 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 4671 time to create 1 rle with old method : 0.0054416656494140625 length of segment : 95 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 11501 time to create 1 rle with old method : 0.013036489486694336 length of segment : 111 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 8740 time to create 1 rle with old method : 0.009734630584716797 length of segment : 89 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 12893 time to create 1 rle with old method : 0.013987302780151367 length of segment : 151 time for calcul the mask position with numpy : 0.00048065185546875 nb_pixel_total : 36357 time to create 1 rle with old method : 0.038338661193847656 length of segment : 183 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 5234 time to create 1 rle with old method : 0.005731105804443359 length of segment : 147 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 15831 time to create 1 rle with old method : 0.01676487922668457 length of segment : 174 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 11790 time to create 1 rle with old method : 0.012681961059570312 length of segment : 182 time for calcul the mask position with numpy : 0.000400543212890625 nb_pixel_total : 23704 time to create 1 rle with old method : 0.025375843048095703 length of segment : 269 time for calcul the mask position with numpy : 0.0002689361572265625 nb_pixel_total : 10775 time to create 1 rle with old method : 0.011597156524658203 length of segment : 165 time for calcul the mask position with numpy : 0.0007665157318115234 nb_pixel_total : 21041 time to create 1 rle with old method : 0.02311539649963379 length of segment : 249 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 6999 time to create 1 rle with old method : 0.007639169692993164 length of segment : 104 time for calcul the mask position with numpy : 0.00017309188842773438 nb_pixel_total : 10285 time to create 1 rle with old method : 0.011447906494140625 length of segment : 118 time for calcul the mask position with numpy : 0.00012302398681640625 nb_pixel_total : 5892 time to create 1 rle with old method : 0.00658726692199707 length of segment : 95 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 20867 time to create 1 rle with old method : 0.022615909576416016 length of segment : 232 time for calcul the mask position with numpy : 0.00020956993103027344 nb_pixel_total : 11298 time to create 1 rle with old method : 0.01728343963623047 length of segment : 140 time for calcul the mask position with numpy : 0.00023317337036132812 nb_pixel_total : 6149 time to create 1 rle with old method : 0.00685429573059082 length of segment : 90 time for calcul the mask position with numpy : 0.0025970935821533203 nb_pixel_total : 92222 time to create 1 rle with old method : 0.09593749046325684 length of segment : 568 time spent for convertir_results : 1.7239141464233398 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 42 chid ids of type : 3594 Number RLEs to save : 6660 save missing photos in datou_result : time spend for datou_step_exec : 27.455814838409424 time spend to save output : 0.40099167823791504 total time spend for step 1 : 27.85680651664734 step2:crop_condition Thu Oct 30 09:11:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 16 ! batch 1 Loaded 42 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761811862_642033 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812540_0.png', 0, 96, 160, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812541_0.png', 0, 95, 152, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f_rle_crop_4003812542_0.png', 0, 112, 194, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812545_0.png', 0, 140, 70, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812551_0.png', 0, 280, 261, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812548_0.png', 0, 90, 109, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812552_0.png', 0, 122, 119, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812549_0.png', 0, 97, 80, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812554_0.png', 0, 113, 89, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812555_0.png', 0, 78, 157, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812553_0.png', 0, 80, 129, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40_rle_crop_4003812556_0.png', 0, 157, 76, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812559_0.png', 0, 104, 163, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812564_0.png', 0, 166, 103, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812561_0.png', 0, 82, 206, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812563_0.png', 0, 94, 93, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2_rle_crop_4003812568_0.png', 0, 84, 147, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812576_0.png', 0, 86, 95, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812574_0.png', 0, 98, 97, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812572_0.png', 0, 167, 165, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812575_0.png', 0, 110, 118, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812578_0.png', 0, 157, 123, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811866), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812577_0.png', 0, 159, 230, 0, 1761811866,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.560838937759399 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761811868_642033 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811868), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52_rle_crop_4003812570_0.png', 0, 103, 177, 0, 1761811868,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5410778522491455 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761811869_642033 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811869), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f_rle_crop_4003812543_0.png', 0, 93, 49, 0, 1761811869,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811869), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812579_0.png', 0, 92, 90, 0, 1761811869,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7751171588897705 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761811871_642033 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812539_0.png', 0, 142, 193, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812546_0.png', 0, 71, 113, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812544_0.png', 0, 108, 64, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812550_0.png', 0, 131, 177, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40_rle_crop_4003812557_0.png', 0, 178, 302, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812560_0.png', 0, 176, 107, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812562_0.png', 0, 105, 113, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812565_0.png', 0, 126, 89, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255225_cfc27a6e8747f5d5223f5f3efea37597_rle_crop_4003812566_0.png', 0, 150, 127, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2_rle_crop_4003812567_0.png', 0, 254, 181, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255200_89520d579d3bfb839634e6d251e66c24_rle_crop_4003812569_0.png', 0, 133, 172, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52_rle_crop_4003812571_0.png', 0, 160, 241, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812573_0.png', 0, 308, 249, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811873), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255125_716aef97ce9e90478182c4ee298d4dc5_rle_crop_4003812580_0.png', 0, 313, 523, 0, 1761811873,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.037682294845581 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761811875_642033 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811875), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812547_0.png', 0, 90, 168, 0, 1761811875,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761811875), 0.0, 0.0, 14, '', 0, 0, '1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812558_0.png', 0, 137, 74, 0, 1761811875,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9074547290802002 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390255313, 1390255252, 1390255250, 1390255247, 1390255244, 1390255242, 1390255241, 1390255233, 1390255225, 1390255220, 1390255212, 1390255200, 1390255193, 1390255129, 1390255127, 1390255125] Looping around the photos to save general results len do output : 42 /1390260153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1390260206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255313', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255252', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255250', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255247', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255244', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255242', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255241', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255233', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255225', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255220', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255212', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255200', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255193', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255129', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255127', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255125', None, None, None, None, None, '3965023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 142 time used for this insertion : 0.026078224182128906 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.333679914474487 time spend to save output : 0.027991533279418945 total time spend for step 2 : 15.361671447753906 step3:rle_unique_nms_with_priority Thu Oct 30 09:11:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 42 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09429478645324707 time for calcul the mask position with numpy : 0.6313056945800781 nb_pixel_total : 2039411 time to create 1 rle with new method : 0.7324843406677246 time for calcul the mask position with numpy : 0.0064618587493896484 nb_pixel_total : 8728 time to create 1 rle with old method : 0.0095977783203125 time for calcul the mask position with numpy : 0.006361246109008789 nb_pixel_total : 9051 time to create 1 rle with old method : 0.01018977165222168 time for calcul the mask position with numpy : 0.006682634353637695 nb_pixel_total : 16410 time to create 1 rle with old method : 0.01834583282470703 create new chi : 1.4316186904907227 time to delete rle : 0.021091699600219727 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2140 TO DO : save crop sub photo not yet done ! save time : 0.14268898963928223 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.37129783630371094 time for calcul the mask position with numpy : 0.07691454887390137 nb_pixel_total : 2058318 time to create 1 rle with new method : 0.2935028076171875 time for calcul the mask position with numpy : 0.006544828414916992 nb_pixel_total : 3834 time to create 1 rle with old method : 0.004109382629394531 time for calcul the mask position with numpy : 0.010157346725463867 nb_pixel_total : 11448 time to create 1 rle with old method : 0.013637304306030273 create new chi : 0.40848302841186523 time to delete rle : 0.0004849433898925781 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1660 TO DO : save crop sub photo not yet done ! save time : 0.11647343635559082 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.6019093990325928 time for calcul the mask position with numpy : 0.10567092895507812 nb_pixel_total : 2043252 time to create 1 rle with new method : 0.10788559913635254 time for calcul the mask position with numpy : 0.007510185241699219 nb_pixel_total : 12077 time to create 1 rle with old method : 0.02005171775817871 time for calcul the mask position with numpy : 0.00742340087890625 nb_pixel_total : 6311 time to create 1 rle with old method : 0.00936269760131836 time for calcul the mask position with numpy : 0.006974458694458008 nb_pixel_total : 7033 time to create 1 rle with old method : 0.00869131088256836 time for calcul the mask position with numpy : 0.007496833801269531 nb_pixel_total : 4927 time to create 1 rle with old method : 0.0058100223541259766 create new chi : 0.2993738651275635 time to delete rle : 0.0003688335418701172 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1932 TO DO : save crop sub photo not yet done ! save time : 0.19484877586364746 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07658123970031738 time for calcul the mask position with numpy : 0.07005739212036133 nb_pixel_total : 1982401 time to create 1 rle with new method : 0.09065747261047363 time for calcul the mask position with numpy : 0.006333112716674805 nb_pixel_total : 10288 time to create 1 rle with old method : 0.011442184448242188 time for calcul the mask position with numpy : 0.006838798522949219 nb_pixel_total : 56243 time to create 1 rle with old method : 0.0646975040435791 time for calcul the mask position with numpy : 0.00657963752746582 nb_pixel_total : 15411 time to create 1 rle with old method : 0.0171053409576416 time for calcul the mask position with numpy : 0.0063838958740234375 nb_pixel_total : 4437 time to create 1 rle with old method : 0.004918575286865234 time for calcul the mask position with numpy : 0.006317615509033203 nb_pixel_total : 4820 time to create 1 rle with old method : 0.0053863525390625 create new chi : 0.3060734272003174 time to delete rle : 0.0004355907440185547 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 2664 TO DO : save crop sub photo not yet done ! save time : 0.18328070640563965 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.056632041931152344 time for calcul the mask position with numpy : 0.03952169418334961 nb_pixel_total : 2049901 time to create 1 rle with new method : 0.05934405326843262 time for calcul the mask position with numpy : 0.006148338317871094 nb_pixel_total : 8629 time to create 1 rle with old method : 0.009560823440551758 time for calcul the mask position with numpy : 0.0062787532806396484 nb_pixel_total : 6749 time to create 1 rle with old method : 0.007526397705078125 time for calcul the mask position with numpy : 0.005931377410888672 nb_pixel_total : 8321 time to create 1 rle with old method : 0.009217262268066406 create new chi : 0.1438586711883545 time to delete rle : 0.0002841949462890625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1864 TO DO : save crop sub photo not yet done ! save time : 0.12947821617126465 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05051064491271973 time for calcul the mask position with numpy : 1.314121961593628 nb_pixel_total : 2029392 time to create 1 rle with new method : 0.10349678993225098 time for calcul the mask position with numpy : 0.007060050964355469 nb_pixel_total : 35327 time to create 1 rle with old method : 0.03857421875 time for calcul the mask position with numpy : 0.0064983367919921875 nb_pixel_total : 8881 time to create 1 rle with old method : 0.01005697250366211 create new chi : 1.4908792972564697 time to delete rle : 0.00032329559326171875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1872 TO DO : save crop sub photo not yet done ! save time : 0.1442856788635254 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.09371089935302734 time for calcul the mask position with numpy : 0.9057836532592773 nb_pixel_total : 2044336 time to create 1 rle with new method : 0.2747018337249756 time for calcul the mask position with numpy : 0.006177186965942383 nb_pixel_total : 11551 time to create 1 rle with old method : 0.012773990631103516 time for calcul the mask position with numpy : 0.006090879440307617 nb_pixel_total : 10818 time to create 1 rle with old method : 0.011760473251342773 time for calcul the mask position with numpy : 0.008502960205078125 nb_pixel_total : 6895 time to create 1 rle with old method : 0.00783085823059082 create new chi : 1.2436938285827637 time to delete rle : 0.00038743019104003906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1770 TO DO : save crop sub photo not yet done ! save time : 0.12087798118591309 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.11427044868469238 time for calcul the mask position with numpy : 0.40306758880615234 nb_pixel_total : 2028197 time to create 1 rle with new method : 0.14899921417236328 time for calcul the mask position with numpy : 0.006667137145996094 nb_pixel_total : 8740 time to create 1 rle with old method : 0.00984644889831543 time for calcul the mask position with numpy : 0.006680011749267578 nb_pixel_total : 11501 time to create 1 rle with old method : 0.013022661209106445 time for calcul the mask position with numpy : 0.006737470626831055 nb_pixel_total : 4671 time to create 1 rle with old method : 0.005283832550048828 time for calcul the mask position with numpy : 0.006647825241088867 nb_pixel_total : 9433 time to create 1 rle with old method : 0.010696649551391602 time for calcul the mask position with numpy : 0.007676124572753906 nb_pixel_total : 11058 time to create 1 rle with old method : 0.014950990676879883 create new chi : 0.6508095264434814 time to delete rle : 0.00041365623474121094 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2324 TO DO : save crop sub photo not yet done ! save time : 0.14505505561828613 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0362246036529541 time for calcul the mask position with numpy : 0.023540019989013672 nb_pixel_total : 2060707 time to create 1 rle with new method : 0.049736738204956055 time for calcul the mask position with numpy : 0.006323099136352539 nb_pixel_total : 12893 time to create 1 rle with old method : 0.014505863189697266 create new chi : 0.0943295955657959 time to delete rle : 0.00021839141845703125 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1382 TO DO : save crop sub photo not yet done ! save time : 0.10450530052185059 No data in photo_id : 1390255220 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.12014460563659668 time for calcul the mask position with numpy : 0.17574334144592285 nb_pixel_total : 2032009 time to create 1 rle with new method : 0.09889101982116699 time for calcul the mask position with numpy : 0.006644248962402344 nb_pixel_total : 5234 time to create 1 rle with old method : 0.005944967269897461 time for calcul the mask position with numpy : 0.0063741207122802734 nb_pixel_total : 36357 time to create 1 rle with old method : 0.04254722595214844 create new chi : 0.3470296859741211 time to delete rle : 0.00041031837463378906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1740 TO DO : save crop sub photo not yet done ! save time : 0.11903142929077148 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04007077217102051 time for calcul the mask position with numpy : 0.028525114059448242 nb_pixel_total : 2057769 time to create 1 rle with new method : 0.1425018310546875 time for calcul the mask position with numpy : 0.006147861480712891 nb_pixel_total : 15831 time to create 1 rle with old method : 0.017720460891723633 create new chi : 0.2024085521697998 time to delete rle : 0.00023794174194335938 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1428 TO DO : save crop sub photo not yet done ! save time : 0.10728716850280762 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04435920715332031 time for calcul the mask position with numpy : 0.0591275691986084 nb_pixel_total : 2038106 time to create 1 rle with new method : 0.10172772407531738 time for calcul the mask position with numpy : 0.006751060485839844 nb_pixel_total : 23704 time to create 1 rle with old method : 0.03809356689453125 time for calcul the mask position with numpy : 0.006707429885864258 nb_pixel_total : 11790 time to create 1 rle with old method : 0.019516468048095703 create new chi : 0.24245333671569824 time to delete rle : 0.0005390644073486328 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1982 TO DO : save crop sub photo not yet done ! save time : 0.15242362022399902 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.261646032333374 time for calcul the mask position with numpy : 0.05645346641540527 nb_pixel_total : 2018608 time to create 1 rle with new method : 0.2594120502471924 time for calcul the mask position with numpy : 0.006751060485839844 nb_pixel_total : 5892 time to create 1 rle with old method : 0.006760835647583008 time for calcul the mask position with numpy : 0.007143974304199219 nb_pixel_total : 10285 time to create 1 rle with old method : 0.011562108993530273 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 6999 time to create 1 rle with old method : 0.007883548736572266 time for calcul the mask position with numpy : 0.006338596343994141 nb_pixel_total : 21041 time to create 1 rle with old method : 0.023568391799926758 time for calcul the mask position with numpy : 0.0063838958740234375 nb_pixel_total : 10775 time to create 1 rle with old method : 0.012151718139648438 create new chi : 0.42316675186157227 time to delete rle : 0.00043582916259765625 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2542 TO DO : save crop sub photo not yet done ! save time : 0.16985130310058594 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05405855178833008 time for calcul the mask position with numpy : 0.023201465606689453 nb_pixel_total : 2035286 time to create 1 rle with new method : 0.22482728958129883 time for calcul the mask position with numpy : 0.00617671012878418 nb_pixel_total : 6149 time to create 1 rle with old method : 0.006925106048583984 time for calcul the mask position with numpy : 0.006003618240356445 nb_pixel_total : 11298 time to create 1 rle with old method : 0.012739181518554688 time for calcul the mask position with numpy : 0.006058692932128906 nb_pixel_total : 20867 time to create 1 rle with old method : 0.02355480194091797 create new chi : 0.3163003921508789 time to delete rle : 0.00035071372985839844 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2004 TO DO : save crop sub photo not yet done ! save time : 0.13200902938842773 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03852963447570801 time for calcul the mask position with numpy : 0.03602027893066406 nb_pixel_total : 1981378 time to create 1 rle with new method : 0.08259391784667969 time for calcul the mask position with numpy : 0.007410526275634766 nb_pixel_total : 92222 time to create 1 rle with old method : 0.12106037139892578 create new chi : 0.2553079128265381 time to delete rle : 0.0003452301025390625 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2216 TO DO : save crop sub photo not yet done ! save time : 0.13616514205932617 map_output_result : {1390255313: (0.0, 'Should be the crop_list due to order', 0), 1390255252: (0.0, 'Should be the crop_list due to order', 0), 1390255250: (0.0, 'Should be the crop_list due to order', 0), 1390255247: (0.0, 'Should be the crop_list due to order', 0), 1390255244: (0.0, 'Should be the crop_list due to order', 0), 1390255242: (0.0, 'Should be the crop_list due to order', 0), 1390255241: (0.0, 'Should be the crop_list due to order', 0), 1390255233: (0.0, 'Should be the crop_list due to order', 0), 1390255225: (0.0, 'Should be the crop_list due to order', 0), 1390255220: (0.0, 'Should be the crop_list due to order', 0.0), 1390255212: (0.0, 'Should be the crop_list due to order', 0), 1390255200: (0.0, 'Should be the crop_list due to order', 0), 1390255193: (0.0, 'Should be the crop_list due to order', 0), 1390255129: (0.0, 'Should be the crop_list due to order', 0), 1390255127: (0.0, 'Should be the crop_list due to order', 0), 1390255125: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390255313, 1390255252, 1390255250, 1390255247, 1390255244, 1390255242, 1390255241, 1390255233, 1390255225, 1390255220, 1390255212, 1390255200, 1390255193, 1390255129, 1390255127, 1390255125] Looping around the photos to save general results len do output : 16 /1390255313.Didn't retrieve data . /1390255252.Didn't retrieve data . /1390255250.Didn't retrieve data . /1390255247.Didn't retrieve data . /1390255244.Didn't retrieve data . /1390255242.Didn't retrieve data . /1390255241.Didn't retrieve data . /1390255233.Didn't retrieve data . /1390255225.Didn't retrieve data . /1390255220.Didn't retrieve data . /1390255212.Didn't retrieve data . /1390255200.Didn't retrieve data . /1390255193.Didn't retrieve data . /1390255129.Didn't retrieve data . /1390255127.Didn't retrieve data . /1390255125.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255313', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255252', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255250', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255247', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255244', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255242', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255241', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255233', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255225', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255220', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255212', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255200', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255193', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255129', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255127', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255125', None, None, None, None, None, '3965023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 48 time used for this insertion : 0.01040959358215332 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.491765260696411 time spend to save output : 0.01104736328125 total time spend for step 3 : 12.502812623977661 step4:ventilate_hashtags_in_portfolio Thu Oct 30 09:11:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27944829 get user id for portfolio 27944829 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27944829 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','background','autre','pet_fonce','mal_croppe','pehd','flou','carton','papier','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27944829 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','background','autre','pet_fonce','mal_croppe','pehd','flou','carton','papier','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27944829 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','background','autre','pet_fonce','mal_croppe','pehd','flou','carton','papier','pet_clair','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27945152,27945153,27945154,27945155,27945156,27945157,27945158,27945159,27945160,27945161,27945162?tags=environnement,background,autre,pet_fonce,mal_croppe,pehd,flou,carton,papier,pet_clair,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390255313, 1390255252, 1390255250, 1390255247, 1390255244, 1390255242, 1390255241, 1390255233, 1390255225, 1390255220, 1390255212, 1390255200, 1390255193, 1390255129, 1390255127, 1390255125] Looping around the photos to save general results len do output : 1 /27944829. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255313', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255252', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255250', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255247', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255244', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255242', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255241', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255233', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255225', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255220', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255212', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255200', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255193', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255129', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255127', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255125', None, None, None, None, None, '3965023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.014649629592895508 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6182634830474854 time spend to save output : 0.014935493469238281 total time spend for step 4 : 0.6331989765167236 step5:final Thu Oct 30 09:11:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390255313: ('0.018233054832175927',), 1390255252: ('0.018233054832175927',), 1390255250: ('0.018233054832175927',), 1390255247: ('0.018233054832175927',), 1390255244: ('0.018233054832175927',), 1390255242: ('0.018233054832175927',), 1390255241: ('0.018233054832175927',), 1390255233: ('0.018233054832175927',), 1390255225: ('0.018233054832175927',), 1390255220: ('0.018233054832175927',), 1390255212: ('0.018233054832175927',), 1390255200: ('0.018233054832175927',), 1390255193: ('0.018233054832175927',), 1390255129: ('0.018233054832175927',), 1390255127: ('0.018233054832175927',), 1390255125: ('0.018233054832175927',)} new output for save of step final : {1390255313: ('0.018233054832175927',), 1390255252: ('0.018233054832175927',), 1390255250: ('0.018233054832175927',), 1390255247: ('0.018233054832175927',), 1390255244: ('0.018233054832175927',), 1390255242: ('0.018233054832175927',), 1390255241: ('0.018233054832175927',), 1390255233: ('0.018233054832175927',), 1390255225: ('0.018233054832175927',), 1390255220: ('0.018233054832175927',), 1390255212: ('0.018233054832175927',), 1390255200: ('0.018233054832175927',), 1390255193: ('0.018233054832175927',), 1390255129: ('0.018233054832175927',), 1390255127: ('0.018233054832175927',), 1390255125: ('0.018233054832175927',)} [1390255313, 1390255252, 1390255250, 1390255247, 1390255244, 1390255242, 1390255241, 1390255233, 1390255225, 1390255220, 1390255212, 1390255200, 1390255193, 1390255129, 1390255127, 1390255125] Looping around the photos to save general results len do output : 16 /1390255313.Didn't retrieve data . /1390255252.Didn't retrieve data . /1390255250.Didn't retrieve data . /1390255247.Didn't retrieve data . /1390255244.Didn't retrieve data . /1390255242.Didn't retrieve data . /1390255241.Didn't retrieve data . /1390255233.Didn't retrieve data . /1390255225.Didn't retrieve data . /1390255220.Didn't retrieve data . /1390255212.Didn't retrieve data . /1390255200.Didn't retrieve data . /1390255193.Didn't retrieve data . /1390255129.Didn't retrieve data . /1390255127.Didn't retrieve data . /1390255125.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255313', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255252', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255250', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255247', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255244', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255242', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255241', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255233', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255225', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255220', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255212', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255200', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255193', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255129', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255127', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255125', None, None, None, None, None, '3965023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 48 time used for this insertion : 0.014105796813964844 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11289787292480469 time spend to save output : 0.014868736267089844 total time spend for step 5 : 0.12776660919189453 step6:blur_detection Thu Oct 30 09:11:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f.jpg resize: (1080, 1920) 1390255313 1.4671263151957912 treat image : temp/1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f.jpg resize: (1080, 1920) 1390255252 1.6137893146195568 treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b.jpg resize: (1080, 1920) 1390255250 0.5800619739407494 treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12.jpg resize: (1080, 1920) 1390255247 0.6825649368169822 treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154.jpg resize: (1080, 1920) 1390255244 2.8766491883623853 treat image : temp/1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40.jpg resize: (1080, 1920) 1390255242 2.820749407215464 treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844.jpg resize: (1080, 1920) 1390255241 1.78094963808181 treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888.jpg resize: (1080, 1920) 1390255233 0.8722537086783182 treat image : temp/1761811830_642033_1390255225_cfc27a6e8747f5d5223f5f3efea37597.jpg resize: (1080, 1920) 1390255225 1.0411636553084418 treat image : temp/1761811830_642033_1390255220_2dd3a0747e4ca311792fdfa6f97d1cc9.jpg resize: (1080, 1920) 1390255220 2.5096900418664863 treat image : temp/1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2.jpg resize: (1080, 1920) 1390255212 -0.10146424005779568 treat image : temp/1761811830_642033_1390255200_89520d579d3bfb839634e6d251e66c24.jpg resize: (1080, 1920) 1390255200 4.796858695810182 treat image : temp/1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52.jpg resize: (1080, 1920) 1390255193 2.5278435003671835 treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61.jpg resize: (1080, 1920) 1390255129 0.7744081523966793 treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5.jpg resize: (1080, 1920) 1390255127 1.642083973639101 treat image : temp/1761811830_642033_1390255125_716aef97ce9e90478182c4ee298d4dc5.jpg resize: (1080, 1920) 1390255125 -0.17853021685206746 treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812540_0.png resize: (160, 96) 1390260153 -1.4967659720628612 treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812541_0.png resize: (152, 95) 1390260154 -1.1247141891687025 treat image : temp/1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f_rle_crop_4003812542_0.png resize: (194, 112) 1390260155 -2.6734881182471297 treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812545_0.png resize: (70, 140) 1390260156 -1.067180533940756 treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812551_0.png resize: (261, 280) 1390260157 -1.0840582351101133 treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812548_0.png resize: (109, 90) 1390260158 -1.1102127191051803 treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812552_0.png resize: (119, 122) 1390260159 0.21957838629648407 treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812549_0.png resize: (80, 97) 1390260160 -2.1507907981688956 treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812554_0.png resize: (89, 113) 1390260161 -1.1993101336365364 treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812555_0.png resize: (157, 78) 1390260162 -0.6881488957555061 treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812553_0.png resize: (129, 80) 1390260163 1.7255515320904502 treat image : temp/1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40_rle_crop_4003812556_0.png resize: (76, 157) 1390260164 0.604927686232821 treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812559_0.png resize: (163, 104) 1390260165 -1.6085250880671333 treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812564_0.png resize: (103, 166) 1390260166 -0.43444476798793746 treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812561_0.png resize: (206, 82) 1390260167 -1.6630023091779502 treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812563_0.png resize: (93, 94) 1390260168 -1.7895381939708306 treat image : temp/1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2_rle_crop_4003812568_0.png resize: (147, 84) 1390260169 -2.1170215414821287 treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812576_0.png resize: (95, 86) 1390260170 -0.576374466556278 treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812574_0.png resize: (97, 98) 1390260171 -0.1298926731911991 treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812572_0.png resize: (165, 167) 1390260172 -1.3462004178959075 treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812575_0.png resize: (118, 110) 1390260173 0.1659248944644703 treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812578_0.png resize: (123, 157) 1390260174 -1.1899706219802806 treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812577_0.png resize: (230, 159) 1390260175 -1.6625015818165738 treat image : temp/1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52_rle_crop_4003812570_0.png resize: (177, 103) 1390260178 -1.699800166095049 treat image : temp/1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f_rle_crop_4003812543_0.png resize: (49, 93) 1390260180 1.7505689075179771 treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812579_0.png resize: (90, 92) 1390260181 -1.3026159884744826 treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812539_0.png resize: (193, 142) 1390260185 -0.4786741115256372 treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812546_0.png resize: (113, 71) 1390260186 -0.5651480440736839 treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812544_0.png resize: (64, 108) 1390260187 -0.4785620158310341 treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812550_0.png resize: (177, 131) 1390260188 -3.232143338147118 treat image : temp/1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40_rle_crop_4003812557_0.png resize: (302, 178) 1390260189 -0.1931857145465895 treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812560_0.png resize: (107, 176) 1390260190 -0.8037134804239565 treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812562_0.png resize: (113, 105) 1390260191 -1.8255873802659663 treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812565_0.png resize: (89, 126) 1390260192 -0.3700343586004217 treat image : temp/1761811830_642033_1390255225_cfc27a6e8747f5d5223f5f3efea37597_rle_crop_4003812566_0.png resize: (127, 150) 1390260193 -2.001042338890995 treat image : temp/1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2_rle_crop_4003812567_0.png resize: (181, 254) 1390260194 -0.22275842754179712 treat image : temp/1761811830_642033_1390255200_89520d579d3bfb839634e6d251e66c24_rle_crop_4003812569_0.png resize: (172, 133) 1390260195 -0.9661112657202263 treat image : temp/1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52_rle_crop_4003812571_0.png resize: (241, 160) 1390260196 -0.30961648478585607 treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812573_0.png resize: (249, 308) 1390260197 -1.5465169710983904 treat image : temp/1761811830_642033_1390255125_716aef97ce9e90478182c4ee298d4dc5_rle_crop_4003812580_0.png resize: (523, 313) 1390260198 -0.66301466080769 treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812547_0.png resize: (168, 90) 1390260205 -0.1523907136460477 treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812558_0.png resize: (74, 137) 1390260206 -1.0994347611411823 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 58 time used for this insertion : 0.011240959167480469 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 58 time used for this insertion : 0.010744094848632812 save missing photos in datou_result : time spend for datou_step_exec : 12.72030258178711 time spend to save output : 0.026822328567504883 total time spend for step 6 : 12.747124910354614 step7:brightness Thu Oct 30 09:11:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f.jpg treat image : temp/1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f.jpg treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b.jpg treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12.jpg treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154.jpg treat image : temp/1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40.jpg treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844.jpg treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888.jpg treat image : temp/1761811830_642033_1390255225_cfc27a6e8747f5d5223f5f3efea37597.jpg treat image : temp/1761811830_642033_1390255220_2dd3a0747e4ca311792fdfa6f97d1cc9.jpg treat image : temp/1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2.jpg treat image : temp/1761811830_642033_1390255200_89520d579d3bfb839634e6d251e66c24.jpg treat image : temp/1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52.jpg treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61.jpg treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5.jpg treat image : temp/1761811830_642033_1390255125_716aef97ce9e90478182c4ee298d4dc5.jpg treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812540_0.png treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812541_0.png treat image : temp/1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f_rle_crop_4003812542_0.png treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812545_0.png treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812551_0.png treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812548_0.png treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812552_0.png treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812549_0.png treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812554_0.png treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812555_0.png treat image : temp/1761811830_642033_1390255244_f95ee343f8be29e2dfa94b998bd04154_rle_crop_4003812553_0.png treat image : temp/1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40_rle_crop_4003812556_0.png treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812559_0.png treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812564_0.png treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812561_0.png treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812563_0.png treat image : temp/1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2_rle_crop_4003812568_0.png treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812576_0.png treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812574_0.png treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812572_0.png treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812575_0.png treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812578_0.png treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812577_0.png treat image : temp/1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52_rle_crop_4003812570_0.png treat image : temp/1761811830_642033_1390255252_dcc07a58b6b39b9e17d3625c36e8dd2f_rle_crop_4003812543_0.png treat image : temp/1761811830_642033_1390255127_87b27a7db63a6ae556a5d4e1653ec7e5_rle_crop_4003812579_0.png treat image : temp/1761811830_642033_1390255313_a867b17a1fa3abf3fba55130d004f43f_rle_crop_4003812539_0.png treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812546_0.png treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812544_0.png treat image : temp/1761811830_642033_1390255247_70665dde7ceea6733bd6dedf70b7ca12_rle_crop_4003812550_0.png treat image : temp/1761811830_642033_1390255242_d5586b40af95ac98391f780efe560b40_rle_crop_4003812557_0.png treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812560_0.png treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812562_0.png treat image : temp/1761811830_642033_1390255233_7edb7d72c18adfc3d0e830f93a5c4888_rle_crop_4003812565_0.png treat image : temp/1761811830_642033_1390255225_cfc27a6e8747f5d5223f5f3efea37597_rle_crop_4003812566_0.png treat image : temp/1761811830_642033_1390255212_1f0c500fcc0a28d785e170052d3b8dc2_rle_crop_4003812567_0.png treat image : temp/1761811830_642033_1390255200_89520d579d3bfb839634e6d251e66c24_rle_crop_4003812569_0.png treat image : temp/1761811830_642033_1390255193_0eef42a68108d0972dbfb1a009bd7b52_rle_crop_4003812571_0.png treat image : temp/1761811830_642033_1390255129_8800a0c2eab8a635cc7a738b87060f61_rle_crop_4003812573_0.png treat image : temp/1761811830_642033_1390255125_716aef97ce9e90478182c4ee298d4dc5_rle_crop_4003812580_0.png treat image : temp/1761811830_642033_1390255250_c5cc2fe50b22f06f131c4d51143f828b_rle_crop_4003812547_0.png treat image : temp/1761811830_642033_1390255241_9b99067b7a3af4da9c995d0b1b1e9844_rle_crop_4003812558_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 58 time used for this insertion : 0.0135040283203125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 58 time used for this insertion : 0.012793302536010742 save missing photos in datou_result : time spend for datou_step_exec : 3.6282336711883545 time spend to save output : 0.030835390090942383 total time spend for step 7 : 3.659069061279297 step8:velours_tree Thu Oct 30 09:11:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14194726943969727 time spend to save output : 3.4809112548828125e-05 total time spend for step 8 : 0.1419820785522461 step9:send_mail_cod Thu Oct 30 09:11:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27944829_30-10-2025_09_11_45.pdf 27945153 imagette279451531761811905 27945154 imagette279451541761811905 27945155 change filename to text .change filename to text .imagette279451551761811905 27945156 imagette279451561761811905 27945157 imagette279451571761811905 27945158 imagette279451581761811905 27945159 change filename to text .imagette279451591761811905 27945160 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette279451601761811905 27945161 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette279451611761811907 27945162 change filename to text .change filename to text .imagette279451621761811908 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27944829 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27945152,27945153,27945154,27945155,27945156,27945157,27945158,27945159,27945160,27945161,27945162?tags=environnement,background,autre,pet_fonce,mal_croppe,pehd,flou,carton,papier,pet_clair,metal args[1390255313] : ((1390255313, 1.4671263151957912, 492688767), (1390255313, 0.6347187303967158, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255252] : ((1390255252, 1.6137893146195568, 492688767), (1390255252, 0.49598523319211363, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255250] : ((1390255250, 0.5800619739407494, 492688767), (1390255250, 0.3933436805792174, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255247] : ((1390255247, 0.6825649368169822, 492688767), (1390255247, 0.3842529735105813, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255244] : ((1390255244, 2.8766491883623853, 492688767), (1390255244, 0.6626900029510913, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255242] : ((1390255242, 2.820749407215464, 492688767), (1390255242, 0.8062195744574466, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255241] : ((1390255241, 1.78094963808181, 492688767), (1390255241, 0.8071929889317094, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255233] : ((1390255233, 0.8722537086783182, 492688767), (1390255233, 0.532684576164442, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255225] : ((1390255225, 1.0411636553084418, 492688767), (1390255225, 0.6692090474032464, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255220] : ((1390255220, 2.5096900418664863, 492688767), (1390255220, 0.567184970674993, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255212] : ((1390255212, -0.10146424005779568, 492688767), (1390255212, 0.747522008619374, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255200] : ((1390255200, 4.796858695810182, 492688767), (1390255200, 0.7138958102463079, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255193] : ((1390255193, 2.5278435003671835, 492688767), (1390255193, 0.6769959185913431, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255129] : ((1390255129, 0.7744081523966793, 492688767), (1390255129, 0.6632699166101924, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255127] : ((1390255127, 1.642083973639101, 492688767), (1390255127, 0.7856880810964996, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com args[1390255125] : ((1390255125, -0.17853021685206746, 492688767), (1390255125, 0.9249764115389904, 2107752395), '0.018233054832175927') We are sending mail with results at report@fotonower.com refus_total : 0.018233054832175927 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27944829 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27944829_30-10-2025_09_11_45.pdf results_Auto_P27944829_30-10-2025_09_11_45.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27944829_30-10-2025_09_11_45.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27944829','results_Auto_P27944829_30-10-2025_09_11_45.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27944829_30-10-2025_09_11_45.pdf','pdf','','0.21','0.018233054832175927') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27944829

https://www.fotonower.com/image?json=false&list_photos_id=1390255313
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.4671263151957912)
https://www.fotonower.com/image?json=false&list_photos_id=1390255252
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6137893146195568)
https://www.fotonower.com/image?json=false&list_photos_id=1390255250
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390255247
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390255244
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.8766491883623853)
https://www.fotonower.com/image?json=false&list_photos_id=1390255242
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.820749407215464)
https://www.fotonower.com/image?json=false&list_photos_id=1390255241
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.78094963808181)
https://www.fotonower.com/image?json=false&list_photos_id=1390255233
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390255225
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0411636553084418)
https://www.fotonower.com/image?json=false&list_photos_id=1390255220
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.5096900418664863)
https://www.fotonower.com/image?json=false&list_photos_id=1390255212
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390255200
La photo est trop floue, merci de reprendre une photo.(avec le score = 4.796858695810182)
https://www.fotonower.com/image?json=false&list_photos_id=1390255193
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.5278435003671835)
https://www.fotonower.com/image?json=false&list_photos_id=1390255129
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390255127
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.642083973639101)
https://www.fotonower.com/image?json=false&list_photos_id=1390255125
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 1.82%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27945155?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27945159?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27945160?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27945161?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27945162?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27944829_30-10-2025_09_11_45.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27945152,27945153,27945154,27945155,27945156,27945157,27945158,27945159,27945160,27945161,27945162?tags=environnement,background,autre,pet_fonce,mal_croppe,pehd,flou,carton,papier,pet_clair,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 30 Oct 2025 08:11:50 GMT Content-Length: 0 Connection: close X-Message-Id: poIus7H1QeeLUFpzP3wrdw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390255313, 1390255252, 1390255250, 1390255247, 1390255244, 1390255242, 1390255241, 1390255233, 1390255225, 1390255220, 1390255212, 1390255200, 1390255193, 1390255129, 1390255127, 1390255125] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255313', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255252', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255250', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255247', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255244', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255242', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255241', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255233', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255225', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255220', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255212', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255200', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255193', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255129', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255127', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255125', None, None, None, None, None, '3965023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 16 time used for this insertion : 0.01121973991394043 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.673635482788086 time spend to save output : 0.011483430862426758 total time spend for step 9 : 4.685118913650513 step10:split_time_score Thu Oct 30 09:11:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 16),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30102025 27944829 Nombre de photos uploadées : 16 / 23040 (0%) 30102025 27944829 Nombre de photos taguées (types de déchets): 0 / 16 (0%) 30102025 27944829 Nombre de photos taguées (volume) : 0 / 16 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ???????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007512569427490234 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19092726707458496 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27944805 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27944806 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27944828 order by id desc limit 1 Qualite : 0.018233054832175927 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27944829_30-10-2025_09_11_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27944829 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27944829 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30102025': {'nb_upload': 16, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390255313, 1390255252, 1390255250, 1390255247, 1390255244, 1390255242, 1390255241, 1390255233, 1390255225, 1390255220, 1390255212, 1390255200, 1390255193, 1390255129, 1390255127, 1390255125] Looping around the photos to save general results len do output : 1 /27944829Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255313', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255252', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255250', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255247', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255244', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255242', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255241', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255233', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255225', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255220', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255212', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255200', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255193', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255129', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255127', None, None, None, None, None, '3965023') ('3318', None, None, None, None, None, None, None, '3965023') ('3318', '27944829', '1390255125', None, None, None, None, None, '3965023') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.012840747833251953 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.111541509628296 time spend to save output : 0.013089179992675781 total time spend for step 10 : 4.124630689620972 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 16 set_done_treatment 42.49user 25.31system 1:27.98elapsed 77%CPU (0avgtext+0avgdata 2947344maxresident)k 500360inputs+13984outputs (0major+1608412minor)pagefaults 0swaps