python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2180101 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3824847'] with mtr_portfolio_ids : ['27463474'] and first list_photo_ids : [] new path : /proc/2180101/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 28 ; length of list_pids : 28 ; length of list_args : 28 time to download the photos : 4.252861261367798 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 3 02:30:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5134 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-03 02:30:36.396956: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-03 02:30:36.424495: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-10-03 02:30:36.426652: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbc68000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-03 02:30:36.426712: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-03 02:30:36.430662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-03 02:30:36.571720: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb3ea630 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-03 02:30:36.571777: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-03 02:30:36.572976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-03 02:30:36.573422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 02:30:36.576648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 02:30:36.579777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-03 02:30:36.580292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-03 02:30:36.583107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-03 02:30:36.584135: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-03 02:30:36.588743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 02:30:36.589958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-03 02:30:36.590032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 02:30:36.590626: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-03 02:30:36.590642: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-03 02:30:36.590651: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-03 02:30:36.591645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4682 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-03 02:30:36.998334: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-03 02:30:36.998426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 02:30:36.998448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 02:30:36.998467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-03 02:30:36.998484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-03 02:30:36.998502: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-03 02:30:36.998519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-03 02:30:36.998537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 02:30:36.999693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-03 02:30:37.000876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-03 02:30:37.000921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-03 02:30:37.000940: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 02:30:37.000958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-03 02:30:37.000974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-03 02:30:37.000991: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-03 02:30:37.001008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-03 02:30:37.001025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 02:30:37.002171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-03 02:30:37.002204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-03 02:30:37.002215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-03 02:30:37.002225: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-03 02:30:37.003426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4682 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-03 02:30:45.322819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-03 02:30:45.521401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-03 02:30:47.001518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.002016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.002460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.002901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.003342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.003783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.004228: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.004256: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.004733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.004750: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.011618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.011639: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.012091: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.012105: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.018451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.018481: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.018932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.018947: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.049260: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.049286: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.049738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.049752: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.055422: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.055441: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.055893: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.055908: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-03 02:30:47.089200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.089668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.091405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.091864: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.135128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.135596: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.137682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.138139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.168334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.168857: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.170493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.171002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.177509: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.178008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.179837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.180328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.187068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.187578: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.189296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.189786: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.221818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.222293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.222749: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.223204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.226618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.227081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.242345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.242821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.243282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.243760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.255953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.256470: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.256939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.257402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.261553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.262020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.266417: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.266882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.278718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.279182: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.283158: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.283619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.284076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.284549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.285157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.285620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.296493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.296953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.297421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.297875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.298328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.298782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.299235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.299699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.308722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.309181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.315263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.315720: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.337087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.337164: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-03 02:30:47.338110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.339038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.346030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.346496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.346970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.347430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.355171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.355634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.370280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.370916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.371542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.372149: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.376225: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.376866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.377429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.377878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.378698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.388809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.389265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.398026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.398488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.398951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.399405: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.399867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-03 02:30:47.400321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 28 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 2180923 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 317 tf kernel not reseted sub process len(results) : 28 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 28 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1221 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005521774291992188 nb_pixel_total : 13588 time to create 1 rle with old method : 0.015255451202392578 length of segment : 212 time for calcul the mask position with numpy : 0.0024001598358154297 nb_pixel_total : 109122 time to create 1 rle with old method : 0.12343883514404297 length of segment : 541 time for calcul the mask position with numpy : 0.02166152000427246 nb_pixel_total : 1165203 time to create 1 rle with new method : 0.07507133483886719 length of segment : 1610 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 7238 time to create 1 rle with old method : 0.008197784423828125 length of segment : 115 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 12798 time to create 1 rle with old method : 0.013980627059936523 length of segment : 152 time for calcul the mask position with numpy : 0.0017254352569580078 nb_pixel_total : 111086 time to create 1 rle with old method : 0.11986064910888672 length of segment : 558 time for calcul the mask position with numpy : 0.0005419254302978516 nb_pixel_total : 39514 time to create 1 rle with old method : 0.04361224174499512 length of segment : 168 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 3618 time to create 1 rle with old method : 0.004074573516845703 length of segment : 78 time for calcul the mask position with numpy : 0.0004799365997314453 nb_pixel_total : 15024 time to create 1 rle with old method : 0.01658010482788086 length of segment : 189 time for calcul the mask position with numpy : 0.0005917549133300781 nb_pixel_total : 25452 time to create 1 rle with old method : 0.028060197830200195 length of segment : 212 time for calcul the mask position with numpy : 0.0003273487091064453 nb_pixel_total : 8827 time to create 1 rle with old method : 0.009990453720092773 length of segment : 116 time for calcul the mask position with numpy : 0.0022809505462646484 nb_pixel_total : 93983 time to create 1 rle with old method : 0.10254478454589844 length of segment : 533 time for calcul the mask position with numpy : 0.013350725173950195 nb_pixel_total : 757699 time to create 1 rle with new method : 0.02946019172668457 length of segment : 977 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 5930 time to create 1 rle with old method : 0.006688833236694336 length of segment : 124 time for calcul the mask position with numpy : 0.0022373199462890625 nb_pixel_total : 91334 time to create 1 rle with old method : 0.09894967079162598 length of segment : 564 time for calcul the mask position with numpy : 0.0002751350402832031 nb_pixel_total : 8638 time to create 1 rle with old method : 0.009551525115966797 length of segment : 98 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 4203 time to create 1 rle with old method : 0.004765987396240234 length of segment : 99 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 9290 time to create 1 rle with old method : 0.010356426239013672 length of segment : 113 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 4080 time to create 1 rle with old method : 0.004771232604980469 length of segment : 56 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 4917 time to create 1 rle with old method : 0.005851268768310547 length of segment : 120 time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 14522 time to create 1 rle with old method : 0.016172409057617188 length of segment : 165 time for calcul the mask position with numpy : 0.0004754066467285156 nb_pixel_total : 13488 time to create 1 rle with old method : 0.014960765838623047 length of segment : 161 time for calcul the mask position with numpy : 0.00044274330139160156 nb_pixel_total : 12174 time to create 1 rle with old method : 0.013234853744506836 length of segment : 209 time for calcul the mask position with numpy : 0.012575387954711914 nb_pixel_total : 730821 time to create 1 rle with new method : 0.01868891716003418 length of segment : 884 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 3849 time to create 1 rle with old method : 0.004175662994384766 length of segment : 141 time for calcul the mask position with numpy : 0.00022125244140625 nb_pixel_total : 11908 time to create 1 rle with old method : 0.013039827346801758 length of segment : 152 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 3833 time to create 1 rle with old method : 0.004467964172363281 length of segment : 78 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 2308 time to create 1 rle with old method : 0.002733469009399414 length of segment : 66 time for calcul the mask position with numpy : 0.0017039775848388672 nb_pixel_total : 122589 time to create 1 rle with old method : 0.13159584999084473 length of segment : 546 time for calcul the mask position with numpy : 0.0009446144104003906 nb_pixel_total : 36079 time to create 1 rle with old method : 0.039711713790893555 length of segment : 186 time for calcul the mask position with numpy : 0.0009856224060058594 nb_pixel_total : 20716 time to create 1 rle with old method : 0.022905588150024414 length of segment : 314 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 15218 time to create 1 rle with old method : 0.01735663414001465 length of segment : 139 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 7621 time to create 1 rle with old method : 0.00891733169555664 length of segment : 108 time for calcul the mask position with numpy : 0.0007157325744628906 nb_pixel_total : 31291 time to create 1 rle with old method : 0.03596687316894531 length of segment : 171 time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 7081 time to create 1 rle with old method : 0.008069276809692383 length of segment : 84 time for calcul the mask position with numpy : 0.0008571147918701172 nb_pixel_total : 38754 time to create 1 rle with old method : 0.044830322265625 length of segment : 312 time for calcul the mask position with numpy : 0.012157917022705078 nb_pixel_total : 716483 time to create 1 rle with new method : 0.01674485206604004 length of segment : 991 time for calcul the mask position with numpy : 0.002096891403198242 nb_pixel_total : 98723 time to create 1 rle with old method : 0.10897946357727051 length of segment : 543 time for calcul the mask position with numpy : 0.002465963363647461 nb_pixel_total : 104072 time to create 1 rle with old method : 0.11408329010009766 length of segment : 532 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 12021 time to create 1 rle with old method : 0.013762712478637695 length of segment : 185 time for calcul the mask position with numpy : 0.0008375644683837891 nb_pixel_total : 43295 time to create 1 rle with old method : 0.048119306564331055 length of segment : 327 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 6685 time to create 1 rle with old method : 0.007621288299560547 length of segment : 97 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 11733 time to create 1 rle with old method : 0.013273239135742188 length of segment : 149 time for calcul the mask position with numpy : 0.002058744430541992 nb_pixel_total : 95811 time to create 1 rle with old method : 0.1061098575592041 length of segment : 516 time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 14587 time to create 1 rle with old method : 0.01703190803527832 length of segment : 143 time for calcul the mask position with numpy : 0.009784698486328125 nb_pixel_total : 724924 time to create 1 rle with new method : 0.015236854553222656 length of segment : 948 time for calcul the mask position with numpy : 0.00042438507080078125 nb_pixel_total : 8496 time to create 1 rle with old method : 0.010152101516723633 length of segment : 175 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 4195 time to create 1 rle with old method : 0.005196332931518555 length of segment : 63 time for calcul the mask position with numpy : 0.00017571449279785156 nb_pixel_total : 7970 time to create 1 rle with old method : 0.009989023208618164 length of segment : 76 time for calcul the mask position with numpy : 0.00018739700317382812 nb_pixel_total : 5451 time to create 1 rle with old method : 0.006751060485839844 length of segment : 65 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 2321 time to create 1 rle with old method : 0.002969503402709961 length of segment : 56 time for calcul the mask position with numpy : 0.012522220611572266 nb_pixel_total : 743713 time to create 1 rle with new method : 0.017955541610717773 length of segment : 965 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 13450 time to create 1 rle with old method : 0.015617132186889648 length of segment : 150 time for calcul the mask position with numpy : 0.001997232437133789 nb_pixel_total : 104349 time to create 1 rle with old method : 0.11690402030944824 length of segment : 519 time for calcul the mask position with numpy : 0.0003261566162109375 nb_pixel_total : 7395 time to create 1 rle with old method : 0.008839845657348633 length of segment : 170 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 19401 time to create 1 rle with old method : 0.022069215774536133 length of segment : 224 time for calcul the mask position with numpy : 0.0007178783416748047 nb_pixel_total : 42914 time to create 1 rle with old method : 0.05041098594665527 length of segment : 145 time for calcul the mask position with numpy : 0.0002300739288330078 nb_pixel_total : 4066 time to create 1 rle with old method : 0.00487828254699707 length of segment : 137 time for calcul the mask position with numpy : 0.019446611404418945 nb_pixel_total : 1383404 time to create 1 rle with new method : 0.10911417007446289 length of segment : 1491 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 9077 time to create 1 rle with old method : 0.011095523834228516 length of segment : 96 time for calcul the mask position with numpy : 0.0007555484771728516 nb_pixel_total : 23710 time to create 1 rle with old method : 0.02805018424987793 length of segment : 232 time for calcul the mask position with numpy : 0.0004055500030517578 nb_pixel_total : 14355 time to create 1 rle with old method : 0.016834497451782227 length of segment : 167 time for calcul the mask position with numpy : 0.00025916099548339844 nb_pixel_total : 8836 time to create 1 rle with old method : 0.010365486145019531 length of segment : 94 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 17297 time to create 1 rle with old method : 0.0203092098236084 length of segment : 144 time for calcul the mask position with numpy : 0.00011444091796875 nb_pixel_total : 4599 time to create 1 rle with old method : 0.005359172821044922 length of segment : 74 time for calcul the mask position with numpy : 0.04475235939025879 nb_pixel_total : 1353919 time to create 1 rle with new method : 0.2626471519470215 length of segment : 1370 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 3908 time to create 1 rle with old method : 0.004722118377685547 length of segment : 132 time for calcul the mask position with numpy : 0.0017008781433105469 nb_pixel_total : 113341 time to create 1 rle with old method : 0.1333763599395752 length of segment : 506 time for calcul the mask position with numpy : 0.0021550655364990234 nb_pixel_total : 105881 time to create 1 rle with old method : 0.11748456954956055 length of segment : 533 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 18184 time to create 1 rle with old method : 0.021181821823120117 length of segment : 189 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 15309 time to create 1 rle with old method : 0.017812252044677734 length of segment : 168 time for calcul the mask position with numpy : 0.00025272369384765625 nb_pixel_total : 3755 time to create 1 rle with old method : 0.00455021858215332 length of segment : 79 time for calcul the mask position with numpy : 0.0005152225494384766 nb_pixel_total : 19809 time to create 1 rle with old method : 0.02352142333984375 length of segment : 160 time for calcul the mask position with numpy : 0.0005517005920410156 nb_pixel_total : 21965 time to create 1 rle with old method : 0.030145883560180664 length of segment : 139 time spent for convertir_results : 6.5644025802612305 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 74 chid ids of type : 3594 Number RLEs to save : 23101 save missing photos in datou_result : time spend for datou_step_exec : 38.21504616737366 time spend to save output : 2.6523213386535645 total time spend for step 1 : 40.86736750602722 step2:crop_condition Fri Oct 3 02:31:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 28 ! batch 1 Loaded 74 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759451476_2180101 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345193_469709c999375a2ba4b26c294161f5fd_rle_crop_3985012066_0.png', 0, 109, 101, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012070_0.png', 0, 72, 78, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345165_b8f6bf1a62ec8d2493d5d1fc05305701_rle_crop_3985012071_0.png', 0, 122, 188, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8_rle_crop_3985012076_0.png', 0, 109, 124, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012081_0.png', 0, 92, 56, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012082_0.png', 0, 138, 120, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012090_0.png', 0, 75, 66, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012089_0.png', 0, 79, 78, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345055_2bec3ce21a9897ad0b6d3ee27ad6442b_rle_crop_3985012109_0.png', 0, 116, 168, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8_rle_crop_3985012110_0.png', 0, 88, 63, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012113_0.png', 0, 56, 55, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012112_0.png', 0, 92, 65, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012117_0.png', 0, 99, 170, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012120_0.png', 0, 41, 136, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012129_0.png', 0, 39, 132, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451478), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012134_0.png', 0, 72, 79, 0, 1759451478,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.786526203155518 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759451482_2180101 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012067_0.png', 0, 127, 152, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012079_0.png', 0, 71, 99, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012083_0.png', 0, 166, 149, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012084_0.png', 0, 129, 160, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012093_0.png', 0, 108, 297, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012088_0.png', 0, 119, 152, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012103_0.png', 0, 275, 302, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012102_0.png', 0, 98, 185, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012104_0.png', 0, 91, 95, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2_rle_crop_3985012105_0.png', 0, 115, 149, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345061_56ca2e5411442eacd66662c6ec0bd6f6_rle_crop_3985012107_0.png', 0, 180, 135, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012115_0.png', 0, 164, 139, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012123_0.png', 0, 164, 231, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012124_0.png', 0, 164, 151, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad_rle_crop_3985012132_0.png', 0, 134, 187, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451486), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012133_0.png', 0, 134, 166, 0, 1759451486,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.10489559173584 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3736932 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759451523_2180101 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012065_0.png', 0, 1395, 1012, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012063_0.png', 0, 111, 210, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012064_0.png', 0, 338, 533, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012069_0.png', 0, 351, 165, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012068_0.png', 0, 340, 552, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb_rle_crop_3985012073_0.png', 0, 121, 116, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb_rle_crop_3985012072_0.png', 0, 144, 209, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c_rle_crop_3985012075_0.png', 0, 1004, 971, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c_rle_crop_3985012074_0.png', 0, 335, 526, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8_rle_crop_3985012077_0.png', 0, 324, 491, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012080_0.png', 0, 100, 113, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012078_0.png', 0, 106, 98, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012086_0.png', 0, 1051, 882, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012085_0.png', 0, 93, 209, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012092_0.png', 0, 268, 184, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012091_0.png', 0, 371, 544, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012099_0.png', 0, 974, 979, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012096_0.png', 0, 250, 171, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012095_0.png', 0, 93, 108, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012094_0.png', 0, 157, 139, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012098_0.png', 0, 413, 193, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012097_0.png', 0, 108, 84, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012100_0.png', 0, 352, 497, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012101_0.png', 0, 344, 527, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2_rle_crop_3985012106_0.png', 0, 323, 509, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345059_6cdb0e24d77b2da5806096b90eaa70af_rle_crop_3985012108_0.png', 0, 995, 943, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8_rle_crop_3985012111_0.png', 0, 126, 76, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012114_0.png', 0, 1041, 958, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012116_0.png', 0, 329, 514, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012121_0.png', 0, 1692, 986, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012119_0.png', 0, 359, 141, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012118_0.png', 0, 138, 224, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012128_0.png', 0, 1548, 980, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012127_0.png', 0, 90, 74, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012130_0.png', 0, 337, 501, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012125_0.png', 0, 119, 94, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012126_0.png', 0, 177, 143, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad_rle_crop_3985012131_0.png', 0, 328, 530, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012136_0.png', 0, 223, 136, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451532), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012135_0.png', 0, 160, 159, 0, 1759451532,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 40 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.952991485595703 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1759451537_2180101 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451538), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012087_0.png', 0, 38, 141, 0, 1759451538,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1759451538), 0.0, 0.0, 14, '', 0, 0, '1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012122_0.png', 0, 134, 96, 0, 1759451538,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9495677947998047 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1387345197, 1387345195, 1387345193, 1387345188, 1387345165, 1387345164, 1387345162, 1387345160, 1387345157, 1387345154, 1387345144, 1387345134, 1387345128, 1387345127, 1387345125, 1387345123, 1387345061, 1387345059, 1387345057, 1387345055, 1387345053, 1387345050, 1387345015, 1387345010, 1387345007, 1387345004, 1387345002, 1387344999] Looping around the photos to save general results len do output : 74 /1387528281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1387528387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345197', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345195', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345193', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345188', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345165', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345164', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345162', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345160', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345157', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345154', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345144', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345134', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345128', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345127', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345125', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345123', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345061', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345059', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345057', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345055', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345053', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345050', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345015', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345010', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345007', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345004', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345002', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387344999', None, None, None, None, None, '3824847') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 250 time used for this insertion : 0.042810678482055664 save_final save missing photos in datou_result : time spend for datou_step_exec : 64.02503180503845 time spend to save output : 0.045835256576538086 total time spend for step 2 : 64.07086706161499 step3:rle_unique_nms_with_priority Fri Oct 3 02:32:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 74 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 1.023270845413208 time for calcul the mask position with numpy : 0.01631951332092285 nb_pixel_total : 799275 time to create 1 rle with new method : 0.0926051139831543 time for calcul the mask position with numpy : 0.16501498222351074 nb_pixel_total : 1151615 time to create 1 rle with new method : 0.07715201377868652 time for calcul the mask position with numpy : 0.0070497989654541016 nb_pixel_total : 109122 time to create 1 rle with old method : 0.11781477928161621 time for calcul the mask position with numpy : 0.00615692138671875 nb_pixel_total : 13588 time to create 1 rle with old method : 0.014539957046508789 create new chi : 0.5132052898406982 time to delete rle : 0.10535788536071777 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 5806 TO DO : save crop sub photo not yet done ! save time : 0.7519063949584961 No data in photo_id : 1387345195 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0678708553314209 time for calcul the mask position with numpy : 0.0392458438873291 nb_pixel_total : 2066362 time to create 1 rle with new method : 0.2973296642303467 time for calcul the mask position with numpy : 0.009330272674560547 nb_pixel_total : 7238 time to create 1 rle with old method : 0.008321046829223633 create new chi : 0.36103224754333496 time to delete rle : 0.000331878662109375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1310 TO DO : save crop sub photo not yet done ! save time : 0.2956714630126953 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.2628788948059082 time for calcul the mask position with numpy : 0.2089695930480957 nb_pixel_total : 1906584 time to create 1 rle with new method : 0.10023379325866699 time for calcul the mask position with numpy : 0.006979227066040039 nb_pixel_total : 3618 time to create 1 rle with old method : 0.004949092864990234 time for calcul the mask position with numpy : 0.006852149963378906 nb_pixel_total : 39514 time to create 1 rle with old method : 0.0446627140045166 time for calcul the mask position with numpy : 0.006482839584350586 nb_pixel_total : 111086 time to create 1 rle with old method : 0.1278855800628662 time for calcul the mask position with numpy : 0.006655454635620117 nb_pixel_total : 12798 time to create 1 rle with old method : 0.014997243881225586 create new chi : 0.539771556854248 time to delete rle : 0.0004715919494628906 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2992 TO DO : save crop sub photo not yet done ! save time : 0.45780301094055176 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032813310623168945 time for calcul the mask position with numpy : 0.019097328186035156 nb_pixel_total : 2058576 time to create 1 rle with new method : 0.12494182586669922 time for calcul the mask position with numpy : 0.006055355072021484 nb_pixel_total : 15024 time to create 1 rle with old method : 0.016826868057250977 create new chi : 0.16716265678405762 time to delete rle : 0.00024366378784179688 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1458 TO DO : save crop sub photo not yet done ! save time : 0.2727644443511963 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.16909003257751465 time for calcul the mask position with numpy : 0.060610294342041016 nb_pixel_total : 2039321 time to create 1 rle with new method : 0.2652890682220459 time for calcul the mask position with numpy : 0.006946086883544922 nb_pixel_total : 8827 time to create 1 rle with old method : 0.01047205924987793 time for calcul the mask position with numpy : 0.0064504146575927734 nb_pixel_total : 25452 time to create 1 rle with old method : 0.04160141944885254 create new chi : 0.40169644355773926 time to delete rle : 0.000408172607421875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1736 TO DO : save crop sub photo not yet done ! save time : 0.3304715156555176 No data in photo_id : 1387345162 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.11364436149597168 time for calcul the mask position with numpy : 0.0998525619506836 nb_pixel_total : 1221918 time to create 1 rle with new method : 0.7091648578643799 time for calcul the mask position with numpy : 0.01601862907409668 nb_pixel_total : 757699 time to create 1 rle with new method : 0.18085622787475586 time for calcul the mask position with numpy : 0.011893510818481445 nb_pixel_total : 93983 time to create 1 rle with old method : 0.1093132495880127 create new chi : 1.1434638500213623 time to delete rle : 0.0007371902465820312 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 4100 TO DO : save crop sub photo not yet done ! save time : 0.5993328094482422 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11625123023986816 time for calcul the mask position with numpy : 0.25716590881347656 nb_pixel_total : 1976336 time to create 1 rle with new method : 0.4345121383666992 time for calcul the mask position with numpy : 0.011118650436401367 nb_pixel_total : 91334 time to create 1 rle with old method : 0.10218381881713867 time for calcul the mask position with numpy : 0.008455038070678711 nb_pixel_total : 5930 time to create 1 rle with old method : 0.0067901611328125 create new chi : 0.8311767578125 time to delete rle : 0.0004711151123046875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2456 TO DO : save crop sub photo not yet done ! save time : 0.40038084983825684 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.4479246139526367 time for calcul the mask position with numpy : 0.26489830017089844 nb_pixel_total : 2051469 time to create 1 rle with new method : 0.22457504272460938 time for calcul the mask position with numpy : 0.01137542724609375 nb_pixel_total : 9290 time to create 1 rle with old method : 0.01636028289794922 time for calcul the mask position with numpy : 0.010945558547973633 nb_pixel_total : 4203 time to create 1 rle with old method : 0.004940986633300781 time for calcul the mask position with numpy : 0.01084136962890625 nb_pixel_total : 8638 time to create 1 rle with old method : 0.01014256477355957 create new chi : 0.5651228427886963 time to delete rle : 0.00041103363037109375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1700 TO DO : save crop sub photo not yet done ! save time : 0.3310732841491699 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06924200057983398 time for calcul the mask position with numpy : 0.07235312461853027 nb_pixel_total : 2050081 time to create 1 rle with new method : 0.18355607986450195 time for calcul the mask position with numpy : 0.006763935089111328 nb_pixel_total : 14522 time to create 1 rle with old method : 0.02408885955810547 time for calcul the mask position with numpy : 0.006707191467285156 nb_pixel_total : 4917 time to create 1 rle with old method : 0.008246660232543945 time for calcul the mask position with numpy : 0.0066835880279541016 nb_pixel_total : 4080 time to create 1 rle with old method : 0.0068225860595703125 create new chi : 0.3289451599121094 time to delete rle : 0.00043320655822753906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1762 TO DO : save crop sub photo not yet done ! save time : 0.3332047462463379 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.32048702239990234 time for calcul the mask position with numpy : 0.04195046424865723 nb_pixel_total : 1316501 time to create 1 rle with new method : 0.24968314170837402 time for calcul the mask position with numpy : 0.0060498714447021484 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007090568542480469 time for calcul the mask position with numpy : 0.012404680252075195 nb_pixel_total : 730821 time to create 1 rle with new method : 0.07206368446350098 time for calcul the mask position with numpy : 0.006265163421630859 nb_pixel_total : 12174 time to create 1 rle with old method : 0.014321327209472656 time for calcul the mask position with numpy : 0.006193876266479492 nb_pixel_total : 13488 time to create 1 rle with old method : 0.016002893447875977 create new chi : 0.4345848560333252 time to delete rle : 0.0006096363067626953 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3636 TO DO : save crop sub photo not yet done ! save time : 0.552471399307251 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.33801913261413574 time for calcul the mask position with numpy : 0.06368851661682129 nb_pixel_total : 1876167 time to create 1 rle with new method : 0.20516514778137207 time for calcul the mask position with numpy : 0.010188817977905273 nb_pixel_total : 20716 time to create 1 rle with old method : 0.025591611862182617 time for calcul the mask position with numpy : 0.007274627685546875 nb_pixel_total : 36079 time to create 1 rle with old method : 0.040472984313964844 time for calcul the mask position with numpy : 0.0069348812103271484 nb_pixel_total : 122589 time to create 1 rle with old method : 0.13448357582092285 time for calcul the mask position with numpy : 0.0058917999267578125 nb_pixel_total : 2308 time to create 1 rle with old method : 0.002714395523071289 time for calcul the mask position with numpy : 0.00587153434753418 nb_pixel_total : 3833 time to create 1 rle with old method : 0.004380941390991211 time for calcul the mask position with numpy : 0.006231546401977539 nb_pixel_total : 11908 time to create 1 rle with old method : 0.012844562530517578 create new chi : 0.5416216850280762 time to delete rle : 0.0006706714630126953 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 3764 TO DO : save crop sub photo not yet done ! save time : 0.5656843185424805 nb_obj : 7 nb_hashtags : 1 time to prepare the origin masks : 0.13460326194763184 time for calcul the mask position with numpy : 0.03593778610229492 nb_pixel_total : 1163552 time to create 1 rle with new method : 0.21646499633789062 time for calcul the mask position with numpy : 0.006525278091430664 nb_pixel_total : 98723 time to create 1 rle with old method : 0.11203646659851074 time for calcul the mask position with numpy : 0.018022537231445312 nb_pixel_total : 716483 time to create 1 rle with new method : 0.16831088066101074 time for calcul the mask position with numpy : 0.010686874389648438 nb_pixel_total : 33631 time to create 1 rle with old method : 0.03844785690307617 time for calcul the mask position with numpy : 0.010066986083984375 nb_pixel_total : 7081 time to create 1 rle with old method : 0.00802922248840332 time for calcul the mask position with numpy : 0.00987100601196289 nb_pixel_total : 31291 time to create 1 rle with old method : 0.035695791244506836 time for calcul the mask position with numpy : 0.0099639892578125 nb_pixel_total : 7621 time to create 1 rle with old method : 0.008555412292480469 time for calcul the mask position with numpy : 0.010155200958251953 nb_pixel_total : 15218 time to create 1 rle with old method : 0.01788806915283203 create new chi : 0.7240109443664551 time to delete rle : 0.0008437633514404297 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 5566 TO DO : save crop sub photo not yet done ! save time : 0.7375895977020264 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.09447717666625977 time for calcul the mask position with numpy : 0.08705615997314453 nb_pixel_total : 1917862 time to create 1 rle with new method : 0.14540576934814453 time for calcul the mask position with numpy : 0.006300210952758789 nb_pixel_total : 6685 time to create 1 rle with old method : 0.011294841766357422 time for calcul the mask position with numpy : 0.006674766540527344 nb_pixel_total : 32960 time to create 1 rle with old method : 0.054685115814208984 time for calcul the mask position with numpy : 0.006951570510864258 nb_pixel_total : 12021 time to create 1 rle with old method : 0.015079021453857422 time for calcul the mask position with numpy : 0.006867647171020508 nb_pixel_total : 104072 time to create 1 rle with old method : 0.11861467361450195 create new chi : 0.471590518951416 time to delete rle : 0.0005095005035400391 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3229 TO DO : save crop sub photo not yet done ! save time : 0.4918694496154785 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03889131546020508 time for calcul the mask position with numpy : 0.0401155948638916 nb_pixel_total : 1966056 time to create 1 rle with new method : 0.12428641319274902 time for calcul the mask position with numpy : 0.006201505661010742 nb_pixel_total : 95811 time to create 1 rle with old method : 0.10677838325500488 time for calcul the mask position with numpy : 0.00625920295715332 nb_pixel_total : 11733 time to create 1 rle with old method : 0.01328277587890625 create new chi : 0.30784177780151367 time to delete rle : 0.0005028247833251953 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2410 TO DO : save crop sub photo not yet done ! save time : 0.3968055248260498 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03435778617858887 time for calcul the mask position with numpy : 0.02083897590637207 nb_pixel_total : 2059013 time to create 1 rle with new method : 0.22037816047668457 time for calcul the mask position with numpy : 0.0060617923736572266 nb_pixel_total : 14587 time to create 1 rle with old method : 0.01666092872619629 create new chi : 0.2745091915130615 time to delete rle : 0.0002589225769042969 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1366 TO DO : save crop sub photo not yet done ! save time : 0.2999725341796875 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0390625 time for calcul the mask position with numpy : 0.0456538200378418 nb_pixel_total : 1348676 time to create 1 rle with new method : 0.1923224925994873 time for calcul the mask position with numpy : 0.010571002960205078 nb_pixel_total : 724924 time to create 1 rle with new method : 0.16131138801574707 create new chi : 0.4189791679382324 time to delete rle : 0.0003001689910888672 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2976 TO DO : save crop sub photo not yet done ! save time : 0.4523594379425049 No data in photo_id : 1387345057 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0625300407409668 time for calcul the mask position with numpy : 0.14071321487426758 nb_pixel_total : 2065104 time to create 1 rle with new method : 0.07817697525024414 time for calcul the mask position with numpy : 0.0059320926666259766 nb_pixel_total : 8496 time to create 1 rle with old method : 0.009497880935668945 create new chi : 0.24479007720947266 time to delete rle : 0.0003085136413574219 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1430 TO DO : save crop sub photo not yet done ! save time : 0.2825493812561035 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.7759697437286377 time for calcul the mask position with numpy : 0.0913388729095459 nb_pixel_total : 2061435 time to create 1 rle with new method : 0.08898282051086426 time for calcul the mask position with numpy : 0.01038813591003418 nb_pixel_total : 7970 time to create 1 rle with old method : 0.009604692459106445 time for calcul the mask position with numpy : 0.006289482116699219 nb_pixel_total : 4195 time to create 1 rle with old method : 0.005018472671508789 create new chi : 0.22271442413330078 time to delete rle : 0.00029277801513671875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1358 TO DO : save crop sub photo not yet done ! save time : 0.29362964630126953 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.1398322582244873 time for calcul the mask position with numpy : 0.045453548431396484 nb_pixel_total : 1322115 time to create 1 rle with new method : 0.10600852966308594 time for calcul the mask position with numpy : 0.012426376342773438 nb_pixel_total : 743713 time to create 1 rle with new method : 0.07422161102294922 time for calcul the mask position with numpy : 0.0059506893157958984 nb_pixel_total : 2321 time to create 1 rle with old method : 0.00254058837890625 time for calcul the mask position with numpy : 0.00585627555847168 nb_pixel_total : 5451 time to create 1 rle with old method : 0.0060787200927734375 create new chi : 0.2685563564300537 time to delete rle : 0.0005409717559814453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3252 TO DO : save crop sub photo not yet done ! save time : 0.49477314949035645 No data in photo_id : 1387345015 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04736828804016113 time for calcul the mask position with numpy : 0.0197293758392334 nb_pixel_total : 1948406 time to create 1 rle with new method : 0.3250730037689209 time for calcul the mask position with numpy : 0.005671262741088867 nb_pixel_total : 7395 time to create 1 rle with old method : 0.007943153381347656 time for calcul the mask position with numpy : 0.006560087203979492 nb_pixel_total : 104349 time to create 1 rle with old method : 0.12549829483032227 time for calcul the mask position with numpy : 0.008548974990844727 nb_pixel_total : 13450 time to create 1 rle with old method : 0.015738964080810547 create new chi : 0.5242972373962402 time to delete rle : 0.0003046989440917969 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2758 TO DO : save crop sub photo not yet done ! save time : 0.4428281784057617 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.11761212348937988 time for calcul the mask position with numpy : 0.011937141418457031 nb_pixel_total : 646368 time to create 1 rle with new method : 0.2924818992614746 time for calcul the mask position with numpy : 0.005802154541015625 nb_pixel_total : 792 time to create 1 rle with old method : 0.0008819103240966797 time for calcul the mask position with numpy : 0.04163765907287598 nb_pixel_total : 1360059 time to create 1 rle with new method : 0.16434860229492188 time for calcul the mask position with numpy : 0.005717754364013672 nb_pixel_total : 4066 time to create 1 rle with old method : 0.0045511722564697266 time for calcul the mask position with numpy : 0.005896568298339844 nb_pixel_total : 42914 time to create 1 rle with old method : 0.04583597183227539 time for calcul the mask position with numpy : 0.006089687347412109 nb_pixel_total : 19401 time to create 1 rle with old method : 0.02109074592590332 create new chi : 0.6203255653381348 time to delete rle : 0.0008065700531005859 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5087 TO DO : save crop sub photo not yet done ! save time : 0.7060747146606445 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.29732275009155273 time for calcul the mask position with numpy : 0.009462594985961914 nb_pixel_total : 575314 time to create 1 rle with new method : 0.08041810989379883 time for calcul the mask position with numpy : 0.007887125015258789 nb_pixel_total : 113284 time to create 1 rle with old method : 0.12817597389221191 time for calcul the mask position with numpy : 0.005923032760620117 nb_pixel_total : 905 time to create 1 rle with old method : 0.0010097026824951172 time for calcul the mask position with numpy : 0.13704633712768555 nb_pixel_total : 1315300 time to create 1 rle with new method : 0.08255910873413086 time for calcul the mask position with numpy : 0.0061452388763427734 nb_pixel_total : 4599 time to create 1 rle with old method : 0.005300045013427734 time for calcul the mask position with numpy : 0.0060999393463134766 nb_pixel_total : 17297 time to create 1 rle with old method : 0.01968526840209961 time for calcul the mask position with numpy : 0.0059473514556884766 nb_pixel_total : 8836 time to create 1 rle with old method : 0.009919404983520508 time for calcul the mask position with numpy : 0.005793571472167969 nb_pixel_total : 14355 time to create 1 rle with old method : 0.0160672664642334 time for calcul the mask position with numpy : 0.005837917327880859 nb_pixel_total : 23710 time to create 1 rle with old method : 0.026120662689208984 create new chi : 0.574878454208374 time to delete rle : 0.0010280609130859375 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 6277 TO DO : save crop sub photo not yet done ! save time : 0.8023464679718018 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04675769805908203 time for calcul the mask position with numpy : 0.022006511688232422 nb_pixel_total : 1949535 time to create 1 rle with new method : 0.03108978271484375 time for calcul the mask position with numpy : 0.005936384201049805 nb_pixel_total : 18184 time to create 1 rle with old method : 0.019937753677368164 time for calcul the mask position with numpy : 0.006355762481689453 nb_pixel_total : 105881 time to create 1 rle with old method : 0.11428380012512207 create new chi : 0.2000119686126709 time to delete rle : 0.0003871917724609375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2524 TO DO : save crop sub photo not yet done ! save time : 0.41301846504211426 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.31601595878601074 time for calcul the mask position with numpy : 0.1483008861541748 nb_pixel_total : 2012762 time to create 1 rle with new method : 0.15772247314453125 time for calcul the mask position with numpy : 0.005828857421875 nb_pixel_total : 21965 time to create 1 rle with old method : 0.02409076690673828 time for calcul the mask position with numpy : 0.005692243576049805 nb_pixel_total : 19809 time to create 1 rle with old method : 0.021628141403198242 time for calcul the mask position with numpy : 0.005601167678833008 nb_pixel_total : 3755 time to create 1 rle with old method : 0.004134178161621094 time for calcul the mask position with numpy : 0.005616664886474609 nb_pixel_total : 15309 time to create 1 rle with old method : 0.01648402214050293 create new chi : 0.4050760269165039 time to delete rle : 0.0003981590270996094 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2172 TO DO : save crop sub photo not yet done ! save time : 0.40253734588623047 map_output_result : {1387345197: (0.0, 'Should be the crop_list due to order', 0), 1387345195: (0.0, 'Should be the crop_list due to order', 0.0), 1387345193: (0.0, 'Should be the crop_list due to order', 0), 1387345188: (0.0, 'Should be the crop_list due to order', 0), 1387345165: (0.0, 'Should be the crop_list due to order', 0), 1387345164: (0.0, 'Should be the crop_list due to order', 0), 1387345162: (0.0, 'Should be the crop_list due to order', 0.0), 1387345160: (0.0, 'Should be the crop_list due to order', 0), 1387345157: (0.0, 'Should be the crop_list due to order', 0), 1387345154: (0.0, 'Should be the crop_list due to order', 0), 1387345144: (0.0, 'Should be the crop_list due to order', 0), 1387345134: (0.0, 'Should be the crop_list due to order', 0), 1387345128: (0.0, 'Should be the crop_list due to order', 0), 1387345127: (0.0, 'Should be the crop_list due to order', 0), 1387345125: (0.0, 'Should be the crop_list due to order', 0), 1387345123: (0.0, 'Should be the crop_list due to order', 0), 1387345061: (0.0, 'Should be the crop_list due to order', 0), 1387345059: (0.0, 'Should be the crop_list due to order', 0), 1387345057: (0.0, 'Should be the crop_list due to order', 0.0), 1387345055: (0.0, 'Should be the crop_list due to order', 0), 1387345053: (0.0, 'Should be the crop_list due to order', 0), 1387345050: (0.0, 'Should be the crop_list due to order', 0), 1387345015: (0.0, 'Should be the crop_list due to order', 0.0), 1387345010: (0.0, 'Should be the crop_list due to order', 0), 1387345007: (0.0, 'Should be the crop_list due to order', 0), 1387345004: (0.0, 'Should be the crop_list due to order', 0), 1387345002: (0.0, 'Should be the crop_list due to order', 0), 1387344999: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1387345197, 1387345195, 1387345193, 1387345188, 1387345165, 1387345164, 1387345162, 1387345160, 1387345157, 1387345154, 1387345144, 1387345134, 1387345128, 1387345127, 1387345125, 1387345123, 1387345061, 1387345059, 1387345057, 1387345055, 1387345053, 1387345050, 1387345015, 1387345010, 1387345007, 1387345004, 1387345002, 1387344999] Looping around the photos to save general results len do output : 28 /1387345197.Didn't retrieve data . /1387345195.Didn't retrieve data . /1387345193.Didn't retrieve data . /1387345188.Didn't retrieve data . /1387345165.Didn't retrieve data . /1387345164.Didn't retrieve data . /1387345162.Didn't retrieve data . /1387345160.Didn't retrieve data . /1387345157.Didn't retrieve data . /1387345154.Didn't retrieve data . /1387345144.Didn't retrieve data . /1387345134.Didn't retrieve data . /1387345128.Didn't retrieve data . /1387345127.Didn't retrieve data . /1387345125.Didn't retrieve data . /1387345123.Didn't retrieve data . /1387345061.Didn't retrieve data . /1387345059.Didn't retrieve data . /1387345057.Didn't retrieve data . /1387345055.Didn't retrieve data . /1387345053.Didn't retrieve data . /1387345050.Didn't retrieve data . /1387345015.Didn't retrieve data . /1387345010.Didn't retrieve data . /1387345007.Didn't retrieve data . /1387345004.Didn't retrieve data . /1387345002.Didn't retrieve data . /1387344999.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345197', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345195', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345193', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345188', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345165', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345164', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345162', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345160', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345157', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345154', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345144', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345134', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345128', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345127', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345125', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345123', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345061', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345059', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345057', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345055', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345053', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345050', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345015', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345010', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345007', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345004', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345002', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387344999', None, None, None, None, None, '3824847') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.038421630859375 save_final save missing photos in datou_result : time spend for datou_step_exec : 28.443110942840576 time spend to save output : 0.03916144371032715 total time spend for step 3 : 28.482272386550903 step4:ventilate_hashtags_in_portfolio Fri Oct 3 02:32:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27463474 get user id for portfolio 27463474 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463474 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','mal_croppe','pehd','background','flou','pet_fonce','autre','metal','pet_clair','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463474 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','mal_croppe','pehd','background','flou','pet_fonce','autre','metal','pet_clair','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463474 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','papier','mal_croppe','pehd','background','flou','pet_fonce','autre','metal','pet_clair','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27465953,27465954,27465955,27465956,27465957,27465958,27465959,27465960,27465961,27465963,27465964?tags=environnement,papier,mal_croppe,pehd,background,flou,pet_fonce,autre,metal,pet_clair,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1387345197, 1387345195, 1387345193, 1387345188, 1387345165, 1387345164, 1387345162, 1387345160, 1387345157, 1387345154, 1387345144, 1387345134, 1387345128, 1387345127, 1387345125, 1387345123, 1387345061, 1387345059, 1387345057, 1387345055, 1387345053, 1387345050, 1387345015, 1387345010, 1387345007, 1387345004, 1387345002, 1387344999] Looping around the photos to save general results len do output : 1 /27463474. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345197', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345195', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345193', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345188', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345165', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345164', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345162', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345160', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345157', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345154', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345144', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345134', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345128', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345127', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345125', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345123', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345061', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345059', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345057', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345055', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345053', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345050', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345015', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345010', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345007', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345004', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345002', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387344999', None, None, None, None, None, '3824847') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.04041028022766113 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.51025652885437 time spend to save output : 0.04075884819030762 total time spend for step 4 : 5.551015377044678 step5:final Fri Oct 3 02:32:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1387345197: ('0.16134142140652558',), 1387345195: ('0.16134142140652558',), 1387345193: ('0.16134142140652558',), 1387345188: ('0.16134142140652558',), 1387345165: ('0.16134142140652558',), 1387345164: ('0.16134142140652558',), 1387345162: ('0.16134142140652558',), 1387345160: ('0.16134142140652558',), 1387345157: ('0.16134142140652558',), 1387345154: ('0.16134142140652558',), 1387345144: ('0.16134142140652558',), 1387345134: ('0.16134142140652558',), 1387345128: ('0.16134142140652558',), 1387345127: ('0.16134142140652558',), 1387345125: ('0.16134142140652558',), 1387345123: ('0.16134142140652558',), 1387345061: ('0.16134142140652558',), 1387345059: ('0.16134142140652558',), 1387345057: ('0.16134142140652558',), 1387345055: ('0.16134142140652558',), 1387345053: ('0.16134142140652558',), 1387345050: ('0.16134142140652558',), 1387345015: ('0.16134142140652558',), 1387345010: ('0.16134142140652558',), 1387345007: ('0.16134142140652558',), 1387345004: ('0.16134142140652558',), 1387345002: ('0.16134142140652558',), 1387344999: ('0.16134142140652558',)} new output for save of step final : {1387345197: ('0.16134142140652558',), 1387345195: ('0.16134142140652558',), 1387345193: ('0.16134142140652558',), 1387345188: ('0.16134142140652558',), 1387345165: ('0.16134142140652558',), 1387345164: ('0.16134142140652558',), 1387345162: ('0.16134142140652558',), 1387345160: ('0.16134142140652558',), 1387345157: ('0.16134142140652558',), 1387345154: ('0.16134142140652558',), 1387345144: ('0.16134142140652558',), 1387345134: ('0.16134142140652558',), 1387345128: ('0.16134142140652558',), 1387345127: ('0.16134142140652558',), 1387345125: ('0.16134142140652558',), 1387345123: ('0.16134142140652558',), 1387345061: ('0.16134142140652558',), 1387345059: ('0.16134142140652558',), 1387345057: ('0.16134142140652558',), 1387345055: ('0.16134142140652558',), 1387345053: ('0.16134142140652558',), 1387345050: ('0.16134142140652558',), 1387345015: ('0.16134142140652558',), 1387345010: ('0.16134142140652558',), 1387345007: ('0.16134142140652558',), 1387345004: ('0.16134142140652558',), 1387345002: ('0.16134142140652558',), 1387344999: ('0.16134142140652558',)} [1387345197, 1387345195, 1387345193, 1387345188, 1387345165, 1387345164, 1387345162, 1387345160, 1387345157, 1387345154, 1387345144, 1387345134, 1387345128, 1387345127, 1387345125, 1387345123, 1387345061, 1387345059, 1387345057, 1387345055, 1387345053, 1387345050, 1387345015, 1387345010, 1387345007, 1387345004, 1387345002, 1387344999] Looping around the photos to save general results len do output : 28 /1387345197.Didn't retrieve data . /1387345195.Didn't retrieve data . /1387345193.Didn't retrieve data . /1387345188.Didn't retrieve data . /1387345165.Didn't retrieve data . /1387345164.Didn't retrieve data . /1387345162.Didn't retrieve data . /1387345160.Didn't retrieve data . /1387345157.Didn't retrieve data . /1387345154.Didn't retrieve data . /1387345144.Didn't retrieve data . /1387345134.Didn't retrieve data . /1387345128.Didn't retrieve data . /1387345127.Didn't retrieve data . /1387345125.Didn't retrieve data . /1387345123.Didn't retrieve data . /1387345061.Didn't retrieve data . /1387345059.Didn't retrieve data . /1387345057.Didn't retrieve data . /1387345055.Didn't retrieve data . /1387345053.Didn't retrieve data . /1387345050.Didn't retrieve data . /1387345015.Didn't retrieve data . /1387345010.Didn't retrieve data . /1387345007.Didn't retrieve data . /1387345004.Didn't retrieve data . /1387345002.Didn't retrieve data . /1387344999.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345197', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345195', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345193', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345188', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345165', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345164', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345162', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345160', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345157', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345154', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345144', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345134', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345128', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345127', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345125', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345123', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345061', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345059', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345057', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345055', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345053', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345050', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345015', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345010', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345007', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345004', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345002', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387344999', None, None, None, None, None, '3824847') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.037880659103393555 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.37087440490722656 time spend to save output : 0.039546966552734375 total time spend for step 5 : 0.41042137145996094 step6:blur_detection Fri Oct 3 02:32:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e.jpg resize: (1080, 1920) 1387345197 -2.0477708161655195 treat image : temp/1759451429_2180101_1387345195_c9fefe2ad1b9f318a8362fe77391cebd.jpg resize: (1080, 1920) 1387345195 -2.3912553352835544 treat image : temp/1759451429_2180101_1387345193_469709c999375a2ba4b26c294161f5fd.jpg resize: (1080, 1920) 1387345193 -2.6791914470175615 treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d.jpg resize: (1080, 1920) 1387345188 -4.491896124681915 treat image : temp/1759451429_2180101_1387345165_b8f6bf1a62ec8d2493d5d1fc05305701.jpg resize: (1080, 1920) 1387345165 -2.5345191715712705 treat image : temp/1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb.jpg resize: (1080, 1920) 1387345164 -1.4583065204662657 treat image : temp/1759451429_2180101_1387345162_b2b600e047dc2925d784f2f9f5d9a850.jpg resize: (1080, 1920) 1387345162 -1.1386123495467666 treat image : temp/1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c.jpg resize: (1080, 1920) 1387345160 -1.6590035461836112 treat image : temp/1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8.jpg resize: (1080, 1920) 1387345157 -1.7619105263542458 treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153.jpg resize: (1080, 1920) 1387345154 -1.4378944067184594 treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a.jpg resize: (1080, 1920) 1387345144 -1.9531324190030062 treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8.jpg resize: (1080, 1920) 1387345134 -1.5247674977001662 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a.jpg resize: (1080, 1920) 1387345128 -4.034153513383045 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48.jpg resize: (1080, 1920) 1387345127 -1.65017261741463 treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace.jpg resize: (1080, 1920) 1387345125 -2.958813061362952 treat image : temp/1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2.jpg resize: (1080, 1920) 1387345123 -1.3091639873754095 treat image : temp/1759451429_2180101_1387345061_56ca2e5411442eacd66662c6ec0bd6f6.jpg resize: (1080, 1920) 1387345061 -2.1959749203739505 treat image : temp/1759451429_2180101_1387345059_6cdb0e24d77b2da5806096b90eaa70af.jpg resize: (1080, 1920) 1387345059 -1.7002095808327622 treat image : temp/1759451429_2180101_1387345057_eb2a67ea0e62bb2a9345c22a697aa545.jpg resize: (1080, 1920) 1387345057 -2.1585299583763065 treat image : temp/1759451429_2180101_1387345055_2bec3ce21a9897ad0b6d3ee27ad6442b.jpg resize: (1080, 1920) 1387345055 -2.722608808654827 treat image : temp/1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8.jpg resize: (1080, 1920) 1387345053 -1.9012536906479367 treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded.jpg resize: (1080, 1920) 1387345050 -1.567233562040841 treat image : temp/1759451429_2180101_1387345015_b622bcbb86e51dd16d61c2aed2fea64c.jpg resize: (1080, 1920) 1387345015 -2.0589774156291676 treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a.jpg resize: (1080, 1920) 1387345010 -2.3772378768795672 treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb.jpg resize: (1080, 1920) 1387345007 -2.5643297160555116 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd.jpg resize: (1080, 1920) 1387345004 -1.775401012841925 treat image : temp/1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad.jpg resize: (1080, 1920) 1387345002 -2.247847080672996 treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921.jpg resize: (1080, 1920) 1387344999 -2.0621066390280185 treat image : temp/1759451429_2180101_1387345193_469709c999375a2ba4b26c294161f5fd_rle_crop_3985012066_0.png resize: (101, 109) 1387528281 -1.179408525546872 treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012070_0.png resize: (78, 72) 1387528282 -4.540006180164424 treat image : temp/1759451429_2180101_1387345165_b8f6bf1a62ec8d2493d5d1fc05305701_rle_crop_3985012071_0.png resize: (188, 122) 1387528283 -1.6967006261999624 treat image : temp/1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8_rle_crop_3985012076_0.png resize: (124, 109) 1387528284 -2.413085112412898 treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012081_0.png resize: (56, 92) 1387528285 3.089665992094502 treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012082_0.png resize: (120, 138) 1387528286 -2.2310326440567185 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012090_0.png resize: (66, 75) 1387528287 -1.9506603976573889 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012089_0.png resize: (78, 79) 1387528289 -3.98518375322131 treat image : temp/1759451429_2180101_1387345055_2bec3ce21a9897ad0b6d3ee27ad6442b_rle_crop_3985012109_0.png resize: (168, 116) 1387528290 -1.9581314511463515 treat image : temp/1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8_rle_crop_3985012110_0.png resize: (63, 88) 1387528291 -0.7830290722717086 treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012113_0.png resize: (55, 56) 1387528292 1.3880588278493793 treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012112_0.png resize: (65, 92) 1387528293 1.356128141200366 treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012117_0.png resize: (170, 99) 1387528294 -1.9718947674561964 treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012120_0.png resize: (136, 41) 1387528295 0.1826108176851995 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012129_0.png resize: (132, 39) 1387528296 -0.2681586347602107 treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012134_0.png resize: (79, 72) 1387528297 -4.10410082932852 treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012067_0.png resize: (152, 127) 1387528301 -1.479927893880721 treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012079_0.png resize: (99, 71) 1387528302 -2.044288951069574 treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012083_0.png resize: (149, 166) 1387528303 -2.0646091590287714 treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012084_0.png resize: (160, 129) 1387528304 -1.51258063378262 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012093_0.png resize: (297, 108) 1387528306 -1.7763561203104827 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012088_0.png resize: (152, 119) 1387528307 -1.5735785475286805 treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012103_0.png resize: (302, 275) 1387528308 -1.651094883016682 treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012102_0.png resize: (185, 98) 1387528309 -1.6682916012576743 treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012104_0.png resize: (95, 91) 1387528310 -0.5295788042582219 treat image : temp/1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2_rle_crop_3985012105_0.png resize: (149, 115) 1387528311 -1.4900655465638355 treat image : temp/1759451429_2180101_1387345061_56ca2e5411442eacd66662c6ec0bd6f6_rle_crop_3985012107_0.png resize: (135, 180) 1387528312 -2.0460748487877627 treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012115_0.png resize: (139, 164) 1387528313 -2.190434854016592 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012123_0.png resize: (231, 164) 1387528314 -1.3983871299007702 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012124_0.png resize: (151, 164) 1387528315 -2.2243027078912525 treat image : temp/1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad_rle_crop_3985012132_0.png resize: (187, 134) 1387528316 -1.8008471597333953 treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012133_0.png resize: (166, 134) 1387528317 -1.407335309512589 treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012065_0.png resize: (1012, 1395) 1387528345 -2.1208742023325695 treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012063_0.png resize: (210, 111) 1387528346 -1.877438387343028 treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012064_0.png resize: (533, 338) 1387528347 0.17726841663698015 treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012069_0.png resize: (165, 351) 1387528348 -4.745689426981855 treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012068_0.png resize: (552, 340) 1387528349 -0.37833120311225404 treat image : temp/1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb_rle_crop_3985012073_0.png resize: (116, 121) 1387528350 -3.1366766786427216 treat image : temp/1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb_rle_crop_3985012072_0.png resize: (209, 144) 1387528351 -0.4190048681867243 treat image : temp/1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c_rle_crop_3985012075_0.png resize: (971, 1004) 1387528352 0.2650196849340767 treat image : temp/1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c_rle_crop_3985012074_0.png resize: (526, 335) 1387528353 -0.48008632106887145 treat image : temp/1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8_rle_crop_3985012077_0.png resize: (491, 324) 1387528354 -0.81004327604514 treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012080_0.png resize: (113, 100) 1387528355 -2.8018271166995947 treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012078_0.png resize: (98, 106) 1387528356 -1.7705972090440658 treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012086_0.png resize: (882, 1051) 1387528357 0.11160533877331692 treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012085_0.png resize: (209, 93) 1387528358 -1.7890644359917245 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012092_0.png resize: (184, 268) 1387528359 -3.37491906754404 treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012091_0.png resize: (544, 371) 1387528360 0.13416979976807397 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012099_0.png resize: (979, 974) 1387528361 -0.12098067118730232 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012096_0.png resize: (171, 250) 1387528362 -4.228839906337318 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012095_0.png resize: (108, 93) 1387528363 -3.6694044893332576 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012094_0.png resize: (139, 157) 1387528364 -4.167980055386201 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012098_0.png resize: (193, 413) 1387528365 -2.091479093817368 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012097_0.png resize: (84, 108) 1387528366 -2.5506958716052925 treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012100_0.png resize: (497, 352) 1387528367 -0.14519754583996916 treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012101_0.png resize: (527, 344) 1387528368 -0.4531716454139985 treat image : temp/1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2_rle_crop_3985012106_0.png resize: (509, 323) 1387528369 -0.29361731962530585 treat image : temp/1759451429_2180101_1387345059_6cdb0e24d77b2da5806096b90eaa70af_rle_crop_3985012108_0.png resize: (943, 995) 1387528370 1.1733283697079468 treat image : temp/1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8_rle_crop_3985012111_0.png resize: (76, 126) 1387528371 -3.911043401120486 treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012114_0.png resize: (958, 1041) 1387528372 0.5707347130963746 treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012116_0.png resize: (514, 329) 1387528373 -0.09914333498684043 treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012121_0.png resize: (986, 1692) 1387528374 -1.7225205162721333 treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012119_0.png resize: (141, 359) 1387528375 -3.4586057962519803 treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012118_0.png resize: (224, 138) 1387528376 -2.8485456233390045 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012128_0.png resize: (980, 1548) 1387528377 -2.0393890836762956 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012127_0.png resize: (74, 90) 1387528378 -1.3449987898709854 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012130_0.png resize: (501, 337) 1387528379 0.17942888277021574 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012125_0.png resize: (94, 119) 1387528380 0.2773082924031685 treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012126_0.png resize: (143, 177) 1387528381 -1.4188499240286878 treat image : temp/1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad_rle_crop_3985012131_0.png resize: (530, 328) 1387528382 -0.061510367974390384 treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012136_0.png resize: (136, 223) 1387528383 -2.8731897447715924 treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012135_0.png resize: (159, 160) 1387528384 -3.0667993285344197 treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012087_0.png resize: (141, 38) 1387528386 0.4392337969632209 treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012122_0.png resize: (96, 134) 1387528387 -3.1116765645859696 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 102 time used for this insertion : 0.04194188117980957 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 102 time used for this insertion : 0.07493376731872559 save missing photos in datou_result : time spend for datou_step_exec : 25.929524660110474 time spend to save output : 0.13538503646850586 total time spend for step 6 : 26.06490969657898 step7:brightness Fri Oct 3 02:33:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e.jpg treat image : temp/1759451429_2180101_1387345195_c9fefe2ad1b9f318a8362fe77391cebd.jpg treat image : temp/1759451429_2180101_1387345193_469709c999375a2ba4b26c294161f5fd.jpg treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d.jpg treat image : temp/1759451429_2180101_1387345165_b8f6bf1a62ec8d2493d5d1fc05305701.jpg treat image : temp/1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb.jpg treat image : temp/1759451429_2180101_1387345162_b2b600e047dc2925d784f2f9f5d9a850.jpg treat image : temp/1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c.jpg treat image : temp/1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8.jpg treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153.jpg treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a.jpg treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8.jpg treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a.jpg treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48.jpg treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace.jpg treat image : temp/1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2.jpg treat image : temp/1759451429_2180101_1387345061_56ca2e5411442eacd66662c6ec0bd6f6.jpg treat image : temp/1759451429_2180101_1387345059_6cdb0e24d77b2da5806096b90eaa70af.jpg treat image : temp/1759451429_2180101_1387345057_eb2a67ea0e62bb2a9345c22a697aa545.jpg treat image : temp/1759451429_2180101_1387345055_2bec3ce21a9897ad0b6d3ee27ad6442b.jpg treat image : temp/1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8.jpg treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded.jpg treat image : temp/1759451429_2180101_1387345015_b622bcbb86e51dd16d61c2aed2fea64c.jpg treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a.jpg treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb.jpg treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd.jpg treat image : temp/1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad.jpg treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921.jpg treat image : temp/1759451429_2180101_1387345193_469709c999375a2ba4b26c294161f5fd_rle_crop_3985012066_0.png treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012070_0.png treat image : temp/1759451429_2180101_1387345165_b8f6bf1a62ec8d2493d5d1fc05305701_rle_crop_3985012071_0.png treat image : temp/1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8_rle_crop_3985012076_0.png treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012081_0.png treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012082_0.png treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012090_0.png treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012089_0.png treat image : temp/1759451429_2180101_1387345055_2bec3ce21a9897ad0b6d3ee27ad6442b_rle_crop_3985012109_0.png treat image : temp/1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8_rle_crop_3985012110_0.png treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012113_0.png treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012112_0.png treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012117_0.png treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012120_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012129_0.png treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012134_0.png treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012067_0.png treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012079_0.png treat image : temp/1759451429_2180101_1387345144_4ba4846efe02a6a420e06647370cd63a_rle_crop_3985012083_0.png treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012084_0.png treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012093_0.png treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012088_0.png treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012103_0.png treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012102_0.png treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012104_0.png treat image : temp/1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2_rle_crop_3985012105_0.png treat image : temp/1759451429_2180101_1387345061_56ca2e5411442eacd66662c6ec0bd6f6_rle_crop_3985012107_0.png treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012115_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012123_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012124_0.png treat image : temp/1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad_rle_crop_3985012132_0.png treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012133_0.png treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012065_0.png treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012063_0.png treat image : temp/1759451429_2180101_1387345197_c067b078fc5d2943624f9ee71e461e2e_rle_crop_3985012064_0.png treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012069_0.png treat image : temp/1759451429_2180101_1387345188_9a7dca10b5171b02fd0b1c21b1f1235d_rle_crop_3985012068_0.png treat image : temp/1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb_rle_crop_3985012073_0.png treat image : temp/1759451429_2180101_1387345164_996a1e92764b3ed4c546f5fb824819fb_rle_crop_3985012072_0.png treat image : temp/1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c_rle_crop_3985012075_0.png treat image : temp/1759451429_2180101_1387345160_f02978789e9574004ede81c08a44c07c_rle_crop_3985012074_0.png treat image : temp/1759451429_2180101_1387345157_c7a07497d6a1002407e86ea38a3d07b8_rle_crop_3985012077_0.png treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012080_0.png treat image : temp/1759451429_2180101_1387345154_662603a266d4138f17f33eab9ff6b153_rle_crop_3985012078_0.png treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012086_0.png treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012085_0.png treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012092_0.png treat image : temp/1759451429_2180101_1387345128_909cc18f460343b544df90f92cc3ba3a_rle_crop_3985012091_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012099_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012096_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012095_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012094_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012098_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012097_0.png treat image : temp/1759451429_2180101_1387345127_9e257fe5ec7d6ab747e1293641dfde48_rle_crop_3985012100_0.png treat image : temp/1759451429_2180101_1387345125_426532b1bfe1e97faffac5b3f86daace_rle_crop_3985012101_0.png treat image : temp/1759451429_2180101_1387345123_2c5d9c09a124d08ab3f84cdd082055e2_rle_crop_3985012106_0.png treat image : temp/1759451429_2180101_1387345059_6cdb0e24d77b2da5806096b90eaa70af_rle_crop_3985012108_0.png treat image : temp/1759451429_2180101_1387345053_a68518f18536ea5ea5e1fc27a45bb8e8_rle_crop_3985012111_0.png treat image : temp/1759451429_2180101_1387345050_d2c5f1b28250d30866ab5c93d531bded_rle_crop_3985012114_0.png treat image : temp/1759451429_2180101_1387345010_fbe9056a7ff4aa2e5a4dcb32cb4cb46a_rle_crop_3985012116_0.png treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012121_0.png treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012119_0.png treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012118_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012128_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012127_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012130_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012125_0.png treat image : temp/1759451429_2180101_1387345004_d74a2da1dc86fd3ce0ffd1e7561acdfd_rle_crop_3985012126_0.png treat image : temp/1759451429_2180101_1387345002_efc7a951af9e350f0f3ad9267bd187ad_rle_crop_3985012131_0.png treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012136_0.png treat image : temp/1759451429_2180101_1387344999_57df13f1f51f2ee3272bfe120ae48921_rle_crop_3985012135_0.png treat image : temp/1759451429_2180101_1387345134_8df94cbebae8f336b552ef878c634fc8_rle_crop_3985012087_0.png treat image : temp/1759451429_2180101_1387345007_aff0b0e7cfb872aee5acfae6e322b1fb_rle_crop_3985012122_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 102 time used for this insertion : 0.03904604911804199 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 102 time used for this insertion : 0.0772714614868164 save missing photos in datou_result : time spend for datou_step_exec : 7.661211252212524 time spend to save output : 0.1346569061279297 total time spend for step 7 : 7.795868158340454 step8:velours_tree Fri Oct 3 02:33:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10815238952636719 time spend to save output : 3.409385681152344e-05 total time spend for step 8 : 0.10818648338317871 step9:send_mail_cod Fri Oct 3 02:33:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27463474_03-10-2025_02_33_26.pdf 27465954 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274659541759451606 27465955 imagette274659551759451607 27465956 imagette274659561759451608 27465957 imagette274659571759451608 27465958 imagette274659581759451608 27465959 imagette274659591759451608 27465960 change filename to text .change filename to text .imagette274659601759451608 27465961 imagette274659611759451608 27465963 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274659631759451608 27465964 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette274659641759451610 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27463474 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27465953,27465954,27465955,27465956,27465957,27465958,27465959,27465960,27465961,27465963,27465964?tags=environnement,papier,mal_croppe,pehd,background,flou,pet_fonce,autre,metal,pet_clair,carton args[1387345197] : ((1387345197, -2.0477708161655195, 492609224), (1387345197, 0.5287481508354892, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345195] : ((1387345195, -2.3912553352835544, 492609224), (1387345195, 0.7560862117733447, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345193] : ((1387345193, -2.6791914470175615, 492609224), (1387345193, 0.5547964248626778, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345188] : ((1387345188, -4.491896124681915, 492609224), (1387345188, 0.4879370508577826, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345165] : ((1387345165, -2.5345191715712705, 492609224), (1387345165, 0.43238864878103916, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345164] : ((1387345164, -1.4583065204662657, 492688767), (1387345164, 0.4734436290339345, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345162] : ((1387345162, -1.1386123495467666, 492688767), (1387345162, 0.654275560328085, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345160] : ((1387345160, -1.6590035461836112, 492688767), (1387345160, 0.6921796086832341, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345157] : ((1387345157, -1.7619105263542458, 492688767), (1387345157, 0.6541732942780928, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345154] : ((1387345154, -1.4378944067184594, 492688767), (1387345154, 0.618730844544113, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345144] : ((1387345144, -1.9531324190030062, 492688767), (1387345144, 0.7096350147629792, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345134] : ((1387345134, -1.5247674977001662, 492688767), (1387345134, 0.43527309348577425, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345128] : ((1387345128, -4.034153513383045, 492609224), (1387345128, 0.3856331875423522, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345127] : ((1387345127, -1.65017261741463, 492688767), (1387345127, 0.5638439228932165, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345125] : ((1387345125, -2.958813061362952, 492609224), (1387345125, 0.43701969931588347, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345123] : ((1387345123, -1.3091639873754095, 492688767), (1387345123, 0.4633900253351856, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345061] : ((1387345061, -2.1959749203739505, 492609224), (1387345061, 0.6198939013755504, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345059] : ((1387345059, -1.7002095808327622, 492688767), (1387345059, 0.7845001865147329, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345057] : ((1387345057, -2.1585299583763065, 492609224), (1387345057, 0.6068599726069704, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345055] : ((1387345055, -2.722608808654827, 492609224), (1387345055, 0.595620122277999, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345053] : ((1387345053, -1.9012536906479367, 492688767), (1387345053, 0.6033958597370419, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345050] : ((1387345050, -1.567233562040841, 492688767), (1387345050, 0.7409237399763828, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345015] : ((1387345015, -2.0589774156291676, 492609224), (1387345015, 0.5196290567550055, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345010] : ((1387345010, -2.3772378768795672, 492609224), (1387345010, 0.3065031325852997, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345007] : ((1387345007, -2.5643297160555116, 492609224), (1387345007, 0.5689079934118294, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345004] : ((1387345004, -1.775401012841925, 492688767), (1387345004, 0.5194995652772663, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387345002] : ((1387345002, -2.247847080672996, 492609224), (1387345002, 0.5152590965645996, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com args[1387344999] : ((1387344999, -2.0621066390280185, 492609224), (1387344999, 0.5139691448477709, 2107752395), '0.16134142140652558') We are sending mail with results at report@fotonower.com refus_total : 0.16134142140652558 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27463474 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463474_03-10-2025_02_33_26.pdf results_Auto_P27463474_03-10-2025_02_33_26.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463474_03-10-2025_02_33_26.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27463474','results_Auto_P27463474_03-10-2025_02_33_26.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463474_03-10-2025_02_33_26.pdf','pdf','','0.73','0.16134142140652558') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27463474

https://www.fotonower.com/image?json=false&list_photos_id=1387345197
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345195
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345193
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345188
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345165
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345164
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345162
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345160
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345157
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345154
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345144
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345134
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345128
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345125
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345123
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345061
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345059
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345057
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345055
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345053
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345050
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345010
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345007
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345004
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387345002
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1387344999
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.13%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/27465954?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27465960?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27465963?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27465964?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463474_03-10-2025_02_33_26.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27465953,27465954,27465955,27465956,27465957,27465958,27465959,27465960,27465961,27465963,27465964?tags=environnement,papier,mal_croppe,pehd,background,flou,pet_fonce,autre,metal,pet_clair,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 03 Oct 2025 00:33:35 GMT Content-Length: 0 Connection: close X-Message-Id: oYjGbKAkQuiQAh3RCfmAnA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1387345197, 1387345195, 1387345193, 1387345188, 1387345165, 1387345164, 1387345162, 1387345160, 1387345157, 1387345154, 1387345144, 1387345134, 1387345128, 1387345127, 1387345125, 1387345123, 1387345061, 1387345059, 1387345057, 1387345055, 1387345053, 1387345050, 1387345015, 1387345010, 1387345007, 1387345004, 1387345002, 1387344999] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345197', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345195', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345193', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345188', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345165', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345164', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345162', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345160', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345157', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345154', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345144', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345134', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345128', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345127', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345125', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345123', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345061', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345059', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345057', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345055', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345053', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345050', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345015', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345010', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345007', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345004', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345002', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387344999', None, None, None, None, None, '3824847') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 28 time used for this insertion : 0.03795337677001953 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.119344711303711 time spend to save output : 0.03832364082336426 total time spend for step 9 : 8.157668352127075 step10:split_time_score Fri Oct 3 02:33:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 28),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02102025 27463474 Nombre de photos uploadées : 28 / 23040 (0%) 02102025 27463474 Nombre de photos taguées (types de déchets): 0 / 28 (0%) 02102025 27463474 Nombre de photos taguées (volume) : 0 / 28 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 7.3909759521484375e-06 ???????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012769699096679688 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6364040374755859 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.016331413089225585 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463472_03-10-2025_01_52_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463472 AND mptpi.`type`=3594 To do Qualite : 0.16134142140652558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463474_03-10-2025_02_33_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463474 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463474 AND mptpi.`type`=3594 To do Qualite : 0.12034529320987657 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463475_03-10-2025_02_07_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463475 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463475 AND mptpi.`type`=3594 To do Qualite : 0.08658143647119344 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463477_03-10-2025_02_17_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463477 AND mptpi.`type`=3594 To do Qualite : 0.06357076260288068 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463481_03-10-2025_02_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463481 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463481 AND mptpi.`type`=3594 To do Qualite : 0.02628632500453886 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463483_03-10-2025_02_13_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463483 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463483 AND mptpi.`type`=3594 To do Qualite : 0.07084245230078562 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463485_03-10-2025_02_01_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463485 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463485 AND mptpi.`type`=3594 To do Qualite : 0.0557065329218107 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463488_03-10-2025_01_51_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463488 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463488 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463504 order by id desc limit 1 Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27463505_03-10-2025_01_31_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27463505 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27463505 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02102025': {'nb_upload': 28, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1387345197, 1387345195, 1387345193, 1387345188, 1387345165, 1387345164, 1387345162, 1387345160, 1387345157, 1387345154, 1387345144, 1387345134, 1387345128, 1387345127, 1387345125, 1387345123, 1387345061, 1387345059, 1387345057, 1387345055, 1387345053, 1387345050, 1387345015, 1387345010, 1387345007, 1387345004, 1387345002, 1387344999] Looping around the photos to save general results len do output : 1 /27463474Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345197', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345195', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345193', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345188', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345165', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345164', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345162', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345160', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345157', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345154', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345144', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345134', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345128', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345127', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345125', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345123', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345061', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345059', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345057', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345055', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345053', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345050', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345015', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345010', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345007', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345004', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387345002', None, None, None, None, None, '3824847') ('3318', None, None, None, None, None, None, None, '3824847') ('3318', '27463474', '1387344999', None, None, None, None, None, '3824847') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.041646480560302734 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.75075101852417 time spend to save output : 0.042002201080322266 total time spend for step 10 : 3.792753219604492 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 28 set_done_treatment 103.68user 37.94system 3:14.05elapsed 72%CPU (0avgtext+0avgdata 3035360maxresident)k 66680inputs+66656outputs (3994major+3007008minor)pagefaults 0swaps