python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1458622 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2869886'] with mtr_portfolio_ids : ['23035151'] and first list_photo_ids : [] new path : /proc/1458622/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.120098114013672 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri May 16 00:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3185 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-16 00:20:32.490162: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-16 00:20:32.519157: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-16 00:20:32.521935: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbe20000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-16 00:20:32.522007: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-16 00:20:32.526754: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-16 00:20:32.780719: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x4356d2f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-16 00:20:32.780792: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-16 00:20:32.781916: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 00:20:32.782398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 00:20:32.788881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 00:20:32.791671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 00:20:32.792104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 00:20:32.795347: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 00:20:32.796625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 00:20:32.801291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 00:20:32.802371: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 00:20:32.802449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 00:20:32.803002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 00:20:32.803020: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 00:20:32.803029: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 00:20:32.803896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2733 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-16 00:20:33.089250: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 00:20:33.089463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 00:20:33.089514: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 00:20:33.089555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 00:20:33.089597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 00:20:33.089636: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 00:20:33.089679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 00:20:33.089720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 00:20:33.092374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 00:20:33.093551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-16 00:20:33.093630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-16 00:20:33.093648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 00:20:33.093664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-16 00:20:33.093679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-16 00:20:33.093693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-16 00:20:33.093708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-16 00:20:33.093723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 00:20:33.094510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-16 00:20:33.094544: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-16 00:20:33.094553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-16 00:20:33.094560: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-16 00:20:33.095359: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2733 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-16 00:20:42.862380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-16 00:20:43.054775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-16 00:20:44.689614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.689690: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.690282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.690299: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.697317: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.697337: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.697883: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.697898: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.704400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.704422: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.704969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.704983: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.735674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.735699: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.736255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.736271: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.742146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.742171: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.742716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.742731: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-16 00:20:44.776432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.777005: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.778831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.779397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.823084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.823639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.825828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.826371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.853186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.853745: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.855249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.855795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.861179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.861727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.863392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.863941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.869731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.870280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.871785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.872334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.898441: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.899011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.899560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.900105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.903529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.904077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.919450: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.920007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.920553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.921099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.933395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.933978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.934533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.935121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.939547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.940139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.944844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.945421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.957375: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.957970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.962064: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.962639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.963234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.963821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.964601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.965181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.975819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.976411: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.977009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.977551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.978093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.978634: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.993305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:44.993869: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.022875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.022960: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-16 00:20:45.023991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.024990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.032242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.032805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.040747: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.041326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.056748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.057379: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.057986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.058575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.062580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.063157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.063751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.064570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.066360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.076006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.076623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.085849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.086472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.087138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.096577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.098560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-16 00:20:45.099654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 1459321 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1992 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3185 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008461475372314453 nb_pixel_total : 19128 time to create 1 rle with old method : 0.0230557918548584 length of segment : 157 time for calcul the mask position with numpy : 0.002223491668701172 nb_pixel_total : 51761 time to create 1 rle with old method : 0.061199188232421875 length of segment : 260 time for calcul the mask position with numpy : 0.008011817932128906 nb_pixel_total : 248697 time to create 1 rle with new method : 0.013857126235961914 length of segment : 472 time for calcul the mask position with numpy : 0.0013051033020019531 nb_pixel_total : 51776 time to create 1 rle with old method : 0.06124138832092285 length of segment : 299 time for calcul the mask position with numpy : 0.0011699199676513672 nb_pixel_total : 45030 time to create 1 rle with old method : 0.0522153377532959 length of segment : 244 time for calcul the mask position with numpy : 0.0008034706115722656 nb_pixel_total : 25490 time to create 1 rle with old method : 0.030875682830810547 length of segment : 154 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 28680 time to create 1 rle with old method : 0.0345149040222168 length of segment : 201 time for calcul the mask position with numpy : 0.0032875537872314453 nb_pixel_total : 249357 time to create 1 rle with new method : 0.011676311492919922 length of segment : 494 time for calcul the mask position with numpy : 0.0015168190002441406 nb_pixel_total : 67855 time to create 1 rle with old method : 0.07606339454650879 length of segment : 194 time for calcul the mask position with numpy : 0.000579833984375 nb_pixel_total : 34815 time to create 1 rle with old method : 0.039502620697021484 length of segment : 216 time for calcul the mask position with numpy : 0.0004401206970214844 nb_pixel_total : 27231 time to create 1 rle with old method : 0.03119516372680664 length of segment : 196 time for calcul the mask position with numpy : 0.0013723373413085938 nb_pixel_total : 91825 time to create 1 rle with old method : 0.10743880271911621 length of segment : 185 time for calcul the mask position with numpy : 0.0013921260833740234 nb_pixel_total : 98498 time to create 1 rle with old method : 0.11645650863647461 length of segment : 377 time for calcul the mask position with numpy : 0.0007655620574951172 nb_pixel_total : 50949 time to create 1 rle with old method : 0.05757951736450195 length of segment : 416 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 16709 time to create 1 rle with old method : 0.02089405059814453 length of segment : 282 time for calcul the mask position with numpy : 0.0013401508331298828 nb_pixel_total : 85361 time to create 1 rle with old method : 0.09972906112670898 length of segment : 314 time for calcul the mask position with numpy : 0.0002837181091308594 nb_pixel_total : 16869 time to create 1 rle with old method : 0.019739627838134766 length of segment : 86 time for calcul the mask position with numpy : 0.0011942386627197266 nb_pixel_total : 75538 time to create 1 rle with old method : 0.09019064903259277 length of segment : 348 time for calcul the mask position with numpy : 0.00037288665771484375 nb_pixel_total : 19812 time to create 1 rle with old method : 0.022583723068237305 length of segment : 163 time for calcul the mask position with numpy : 0.0003819465637207031 nb_pixel_total : 27011 time to create 1 rle with old method : 0.03351449966430664 length of segment : 171 time for calcul the mask position with numpy : 0.0012166500091552734 nb_pixel_total : 73312 time to create 1 rle with old method : 0.10175371170043945 length of segment : 459 time for calcul the mask position with numpy : 0.00133514404296875 nb_pixel_total : 85107 time to create 1 rle with old method : 0.09461545944213867 length of segment : 478 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 10595 time to create 1 rle with old method : 0.012456893920898438 length of segment : 143 time for calcul the mask position with numpy : 0.0008292198181152344 nb_pixel_total : 15620 time to create 1 rle with old method : 0.019475221633911133 length of segment : 208 time for calcul the mask position with numpy : 0.025300264358520508 nb_pixel_total : 445168 time to create 1 rle with new method : 0.04629349708557129 length of segment : 1183 time for calcul the mask position with numpy : 0.0017445087432861328 nb_pixel_total : 44964 time to create 1 rle with old method : 0.05465960502624512 length of segment : 319 time for calcul the mask position with numpy : 0.0013747215270996094 nb_pixel_total : 30588 time to create 1 rle with old method : 0.037713050842285156 length of segment : 291 time for calcul the mask position with numpy : 0.0016295909881591797 nb_pixel_total : 47967 time to create 1 rle with old method : 0.05365347862243652 length of segment : 233 time for calcul the mask position with numpy : 0.0007343292236328125 nb_pixel_total : 14655 time to create 1 rle with old method : 0.019089937210083008 length of segment : 134 time for calcul the mask position with numpy : 0.00034737586975097656 nb_pixel_total : 7087 time to create 1 rle with old method : 0.008643388748168945 length of segment : 142 time for calcul the mask position with numpy : 0.0005741119384765625 nb_pixel_total : 18016 time to create 1 rle with old method : 0.020885467529296875 length of segment : 214 time for calcul the mask position with numpy : 0.00437164306640625 nb_pixel_total : 149347 time to create 1 rle with old method : 0.17053437232971191 length of segment : 371 time for calcul the mask position with numpy : 0.005892276763916016 nb_pixel_total : 211554 time to create 1 rle with new method : 0.010671615600585938 length of segment : 442 time for calcul the mask position with numpy : 0.0016219615936279297 nb_pixel_total : 36776 time to create 1 rle with old method : 0.04146242141723633 length of segment : 226 time for calcul the mask position with numpy : 0.0003218650817871094 nb_pixel_total : 5542 time to create 1 rle with old method : 0.006576061248779297 length of segment : 101 time for calcul the mask position with numpy : 0.0014774799346923828 nb_pixel_total : 40747 time to create 1 rle with old method : 0.0459284782409668 length of segment : 315 time for calcul the mask position with numpy : 0.0015416145324707031 nb_pixel_total : 56062 time to create 1 rle with old method : 0.06379437446594238 length of segment : 219 time for calcul the mask position with numpy : 0.0027701854705810547 nb_pixel_total : 123772 time to create 1 rle with old method : 0.1444563865661621 length of segment : 401 time for calcul the mask position with numpy : 0.003724336624145508 nb_pixel_total : 107000 time to create 1 rle with old method : 0.11953234672546387 length of segment : 429 time for calcul the mask position with numpy : 0.012383699417114258 nb_pixel_total : 595211 time to create 1 rle with new method : 0.44655847549438477 length of segment : 582 time for calcul the mask position with numpy : 0.003398895263671875 nb_pixel_total : 103860 time to create 1 rle with old method : 0.11738872528076172 length of segment : 339 time for calcul the mask position with numpy : 0.0038743019104003906 nb_pixel_total : 108032 time to create 1 rle with old method : 0.14496541023254395 length of segment : 710 time for calcul the mask position with numpy : 0.0025205612182617188 nb_pixel_total : 90074 time to create 1 rle with old method : 0.10006499290466309 length of segment : 370 time for calcul the mask position with numpy : 0.0019080638885498047 nb_pixel_total : 78123 time to create 1 rle with old method : 0.0874333381652832 length of segment : 442 time for calcul the mask position with numpy : 0.0007660388946533203 nb_pixel_total : 28262 time to create 1 rle with old method : 0.03203725814819336 length of segment : 308 time for calcul the mask position with numpy : 0.00793600082397461 nb_pixel_total : 234671 time to create 1 rle with new method : 0.02880859375 length of segment : 1321 time for calcul the mask position with numpy : 0.00443267822265625 nb_pixel_total : 117196 time to create 1 rle with old method : 0.12865328788757324 length of segment : 814 time for calcul the mask position with numpy : 0.002622842788696289 nb_pixel_total : 110916 time to create 1 rle with old method : 0.12455201148986816 length of segment : 744 time for calcul the mask position with numpy : 0.003975868225097656 nb_pixel_total : 141444 time to create 1 rle with old method : 0.1586017608642578 length of segment : 450 time for calcul the mask position with numpy : 0.0050241947174072266 nb_pixel_total : 139417 time to create 1 rle with old method : 0.15602350234985352 length of segment : 429 time for calcul the mask position with numpy : 0.005101442337036133 nb_pixel_total : 191655 time to create 1 rle with new method : 0.009022235870361328 length of segment : 303 time for calcul the mask position with numpy : 0.0071947574615478516 nb_pixel_total : 213043 time to create 1 rle with new method : 0.012829780578613281 length of segment : 614 time for calcul the mask position with numpy : 0.0026788711547851562 nb_pixel_total : 72263 time to create 1 rle with old method : 0.08315348625183105 length of segment : 328 time for calcul the mask position with numpy : 0.0020880699157714844 nb_pixel_total : 77916 time to create 1 rle with old method : 0.08918452262878418 length of segment : 200 time for calcul the mask position with numpy : 0.0009906291961669922 nb_pixel_total : 31713 time to create 1 rle with old method : 0.035675764083862305 length of segment : 217 time for calcul the mask position with numpy : 0.0014638900756835938 nb_pixel_total : 38592 time to create 1 rle with old method : 0.04361104965209961 length of segment : 206 time for calcul the mask position with numpy : 0.001672506332397461 nb_pixel_total : 52221 time to create 1 rle with old method : 0.05871319770812988 length of segment : 280 time for calcul the mask position with numpy : 0.0025169849395751953 nb_pixel_total : 83438 time to create 1 rle with old method : 0.09462571144104004 length of segment : 374 time for calcul the mask position with numpy : 0.00279998779296875 nb_pixel_total : 88110 time to create 1 rle with old method : 0.10035204887390137 length of segment : 323 time for calcul the mask position with numpy : 0.004401445388793945 nb_pixel_total : 139112 time to create 1 rle with old method : 0.15349173545837402 length of segment : 596 time for calcul the mask position with numpy : 0.0016880035400390625 nb_pixel_total : 42766 time to create 1 rle with old method : 0.051596641540527344 length of segment : 225 time for calcul the mask position with numpy : 0.0006206035614013672 nb_pixel_total : 14076 time to create 1 rle with old method : 0.016381025314331055 length of segment : 128 time for calcul the mask position with numpy : 0.0007176399230957031 nb_pixel_total : 17301 time to create 1 rle with old method : 0.019734621047973633 length of segment : 148 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 22024 time to create 1 rle with old method : 0.02525639533996582 length of segment : 298 time for calcul the mask position with numpy : 0.0006091594696044922 nb_pixel_total : 13167 time to create 1 rle with old method : 0.015365362167358398 length of segment : 158 time for calcul the mask position with numpy : 0.0007801055908203125 nb_pixel_total : 27828 time to create 1 rle with old method : 0.03258347511291504 length of segment : 183 time for calcul the mask position with numpy : 0.0010943412780761719 nb_pixel_total : 24662 time to create 1 rle with old method : 0.028988361358642578 length of segment : 286 time for calcul the mask position with numpy : 0.0017745494842529297 nb_pixel_total : 46389 time to create 1 rle with old method : 0.05397224426269531 length of segment : 214 time for calcul the mask position with numpy : 0.0011706352233886719 nb_pixel_total : 33626 time to create 1 rle with old method : 0.038623809814453125 length of segment : 243 time for calcul the mask position with numpy : 0.0005269050598144531 nb_pixel_total : 15804 time to create 1 rle with old method : 0.0187380313873291 length of segment : 93 time for calcul the mask position with numpy : 0.0023114681243896484 nb_pixel_total : 61624 time to create 1 rle with old method : 0.0693051815032959 length of segment : 321 time for calcul the mask position with numpy : 0.0008132457733154297 nb_pixel_total : 23620 time to create 1 rle with old method : 0.02668929100036621 length of segment : 178 time for calcul the mask position with numpy : 0.0014069080352783203 nb_pixel_total : 43450 time to create 1 rle with old method : 0.05071663856506348 length of segment : 190 time for calcul the mask position with numpy : 0.001886129379272461 nb_pixel_total : 62318 time to create 1 rle with old method : 0.07413911819458008 length of segment : 234 time for calcul the mask position with numpy : 0.008514404296875 nb_pixel_total : 298847 time to create 1 rle with new method : 0.01539921760559082 length of segment : 881 time for calcul the mask position with numpy : 0.0011887550354003906 nb_pixel_total : 21689 time to create 1 rle with old method : 0.024397611618041992 length of segment : 292 time for calcul the mask position with numpy : 0.0021448135375976562 nb_pixel_total : 42828 time to create 1 rle with old method : 0.04764366149902344 length of segment : 366 time for calcul the mask position with numpy : 0.011229515075683594 nb_pixel_total : 324848 time to create 1 rle with new method : 0.04490399360656738 length of segment : 574 time for calcul the mask position with numpy : 0.0007271766662597656 nb_pixel_total : 17505 time to create 1 rle with old method : 0.020229816436767578 length of segment : 161 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 8191 time to create 1 rle with old method : 0.01031637191772461 length of segment : 109 time for calcul the mask position with numpy : 0.001123666763305664 nb_pixel_total : 31930 time to create 1 rle with old method : 0.03716015815734863 length of segment : 173 time for calcul the mask position with numpy : 0.006035804748535156 nb_pixel_total : 228415 time to create 1 rle with new method : 0.009961843490600586 length of segment : 446 time for calcul the mask position with numpy : 0.0029382705688476562 nb_pixel_total : 68669 time to create 1 rle with old method : 0.0770120620727539 length of segment : 343 time for calcul the mask position with numpy : 0.0007452964782714844 nb_pixel_total : 12474 time to create 1 rle with old method : 0.014697790145874023 length of segment : 132 time for calcul the mask position with numpy : 0.0013747215270996094 nb_pixel_total : 25563 time to create 1 rle with old method : 0.029688596725463867 length of segment : 208 time for calcul the mask position with numpy : 0.0014681816101074219 nb_pixel_total : 34857 time to create 1 rle with old method : 0.038931846618652344 length of segment : 184 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 8562 time to create 1 rle with old method : 0.010229825973510742 length of segment : 90 time for calcul the mask position with numpy : 0.0012707710266113281 nb_pixel_total : 30901 time to create 1 rle with old method : 0.0338895320892334 length of segment : 225 time for calcul the mask position with numpy : 0.0009086132049560547 nb_pixel_total : 17737 time to create 1 rle with old method : 0.02024555206298828 length of segment : 112 time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 15185 time to create 1 rle with old method : 0.017409563064575195 length of segment : 125 time for calcul the mask position with numpy : 0.002109527587890625 nb_pixel_total : 53465 time to create 1 rle with old method : 0.06001901626586914 length of segment : 451 time for calcul the mask position with numpy : 0.0016558170318603516 nb_pixel_total : 32021 time to create 1 rle with old method : 0.036588191986083984 length of segment : 249 time for calcul the mask position with numpy : 0.0013320446014404297 nb_pixel_total : 34495 time to create 1 rle with old method : 0.03743743896484375 length of segment : 220 time for calcul the mask position with numpy : 0.0009827613830566406 nb_pixel_total : 21064 time to create 1 rle with old method : 0.023674964904785156 length of segment : 169 time for calcul the mask position with numpy : 0.0030906200408935547 nb_pixel_total : 51250 time to create 1 rle with old method : 0.05717635154724121 length of segment : 260 time for calcul the mask position with numpy : 0.004582643508911133 nb_pixel_total : 94447 time to create 1 rle with old method : 0.10503292083740234 length of segment : 324 time for calcul the mask position with numpy : 0.0011339187622070312 nb_pixel_total : 21998 time to create 1 rle with old method : 0.025611162185668945 length of segment : 143 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 9499 time to create 1 rle with old method : 0.011429786682128906 length of segment : 117 time for calcul the mask position with numpy : 0.0010263919830322266 nb_pixel_total : 23599 time to create 1 rle with old method : 0.02644062042236328 length of segment : 193 time for calcul the mask position with numpy : 0.00451970100402832 nb_pixel_total : 101752 time to create 1 rle with old method : 0.11251425743103027 length of segment : 432 time for calcul the mask position with numpy : 0.0012900829315185547 nb_pixel_total : 34532 time to create 1 rle with old method : 0.03926992416381836 length of segment : 142 time for calcul the mask position with numpy : 0.001556396484375 nb_pixel_total : 39570 time to create 1 rle with old method : 0.04392194747924805 length of segment : 236 time for calcul the mask position with numpy : 0.0022211074829101562 nb_pixel_total : 60060 time to create 1 rle with old method : 0.06686639785766602 length of segment : 278 time for calcul the mask position with numpy : 0.0013887882232666016 nb_pixel_total : 26182 time to create 1 rle with old method : 0.02910614013671875 length of segment : 196 time for calcul the mask position with numpy : 0.0017049312591552734 nb_pixel_total : 28377 time to create 1 rle with old method : 0.031002521514892578 length of segment : 228 time for calcul the mask position with numpy : 0.0021660327911376953 nb_pixel_total : 53819 time to create 1 rle with old method : 0.057301998138427734 length of segment : 334 time for calcul the mask position with numpy : 0.0009984970092773438 nb_pixel_total : 27036 time to create 1 rle with old method : 0.030845165252685547 length of segment : 201 time for calcul the mask position with numpy : 0.006285190582275391 nb_pixel_total : 182929 time to create 1 rle with new method : 0.011069536209106445 length of segment : 409 time for calcul the mask position with numpy : 0.0012888908386230469 nb_pixel_total : 36112 time to create 1 rle with old method : 0.04026460647583008 length of segment : 250 time for calcul the mask position with numpy : 0.0018703937530517578 nb_pixel_total : 56410 time to create 1 rle with old method : 0.06226015090942383 length of segment : 289 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 11504 time to create 1 rle with old method : 0.01347041130065918 length of segment : 83 time for calcul the mask position with numpy : 0.001415252685546875 nb_pixel_total : 39240 time to create 1 rle with old method : 0.044928550720214844 length of segment : 284 time for calcul the mask position with numpy : 0.0014460086822509766 nb_pixel_total : 32403 time to create 1 rle with old method : 0.03897523880004883 length of segment : 145 time for calcul the mask position with numpy : 0.0007729530334472656 nb_pixel_total : 18456 time to create 1 rle with old method : 0.021822214126586914 length of segment : 114 time for calcul the mask position with numpy : 0.0007672309875488281 nb_pixel_total : 21821 time to create 1 rle with old method : 0.02618718147277832 length of segment : 167 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 5226 time to create 1 rle with old method : 0.006410121917724609 length of segment : 116 time for calcul the mask position with numpy : 0.002536773681640625 nb_pixel_total : 87493 time to create 1 rle with old method : 0.09913086891174316 length of segment : 458 time for calcul the mask position with numpy : 0.002408266067504883 nb_pixel_total : 80991 time to create 1 rle with old method : 0.09129166603088379 length of segment : 399 time for calcul the mask position with numpy : 0.002508878707885742 nb_pixel_total : 40864 time to create 1 rle with old method : 0.04753565788269043 length of segment : 254 time for calcul the mask position with numpy : 0.0012183189392089844 nb_pixel_total : 20587 time to create 1 rle with old method : 0.02416372299194336 length of segment : 219 time for calcul the mask position with numpy : 0.004490375518798828 nb_pixel_total : 122039 time to create 1 rle with old method : 0.14063000679016113 length of segment : 479 time for calcul the mask position with numpy : 0.0012669563293457031 nb_pixel_total : 14463 time to create 1 rle with old method : 0.01717543601989746 length of segment : 383 time for calcul the mask position with numpy : 0.0024831295013427734 nb_pixel_total : 102443 time to create 1 rle with old method : 0.11631941795349121 length of segment : 687 time for calcul the mask position with numpy : 0.0028066635131835938 nb_pixel_total : 92006 time to create 1 rle with old method : 0.1299724578857422 length of segment : 475 time for calcul the mask position with numpy : 0.002720355987548828 nb_pixel_total : 109160 time to create 1 rle with old method : 0.11902570724487305 length of segment : 267 time for calcul the mask position with numpy : 0.000576019287109375 nb_pixel_total : 16990 time to create 1 rle with old method : 0.03152632713317871 length of segment : 240 time for calcul the mask position with numpy : 0.007871150970458984 nb_pixel_total : 293716 time to create 1 rle with new method : 0.03096795082092285 length of segment : 992 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 31792 time to create 1 rle with old method : 0.03409576416015625 length of segment : 166 time for calcul the mask position with numpy : 0.001554727554321289 nb_pixel_total : 75199 time to create 1 rle with old method : 0.08462142944335938 length of segment : 320 time for calcul the mask position with numpy : 0.0011441707611083984 nb_pixel_total : 57655 time to create 1 rle with old method : 0.06485700607299805 length of segment : 329 time for calcul the mask position with numpy : 0.0005438327789306641 nb_pixel_total : 15478 time to create 1 rle with old method : 0.018399715423583984 length of segment : 135 time for calcul the mask position with numpy : 0.0003924369812011719 nb_pixel_total : 14980 time to create 1 rle with old method : 0.018534421920776367 length of segment : 99 time for calcul the mask position with numpy : 0.0007481575012207031 nb_pixel_total : 19446 time to create 1 rle with old method : 0.022305011749267578 length of segment : 242 time for calcul the mask position with numpy : 0.0007624626159667969 nb_pixel_total : 20769 time to create 1 rle with old method : 0.023812294006347656 length of segment : 201 time for calcul the mask position with numpy : 0.0006330013275146484 nb_pixel_total : 17709 time to create 1 rle with old method : 0.020189285278320312 length of segment : 205 time for calcul the mask position with numpy : 0.0005249977111816406 nb_pixel_total : 14839 time to create 1 rle with old method : 0.017386198043823242 length of segment : 110 time for calcul the mask position with numpy : 0.0009517669677734375 nb_pixel_total : 48790 time to create 1 rle with old method : 0.05514121055603027 length of segment : 282 time for calcul the mask position with numpy : 0.0006206035614013672 nb_pixel_total : 36057 time to create 1 rle with old method : 0.041347503662109375 length of segment : 196 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 19465 time to create 1 rle with old method : 0.023100852966308594 length of segment : 169 time for calcul the mask position with numpy : 0.0005211830139160156 nb_pixel_total : 16099 time to create 1 rle with old method : 0.018646955490112305 length of segment : 115 time for calcul the mask position with numpy : 0.0009055137634277344 nb_pixel_total : 25485 time to create 1 rle with old method : 0.029716968536376953 length of segment : 178 time for calcul the mask position with numpy : 0.0003635883331298828 nb_pixel_total : 15097 time to create 1 rle with old method : 0.017742156982421875 length of segment : 119 time for calcul the mask position with numpy : 0.004828929901123047 nb_pixel_total : 190761 time to create 1 rle with new method : 0.009585380554199219 length of segment : 581 time for calcul the mask position with numpy : 0.0003840923309326172 nb_pixel_total : 9229 time to create 1 rle with old method : 0.010794639587402344 length of segment : 125 time for calcul the mask position with numpy : 0.0004951953887939453 nb_pixel_total : 17492 time to create 1 rle with old method : 0.020244121551513672 length of segment : 187 time for calcul the mask position with numpy : 0.000530242919921875 nb_pixel_total : 12413 time to create 1 rle with old method : 0.014836549758911133 length of segment : 101 time for calcul the mask position with numpy : 0.0008978843688964844 nb_pixel_total : 26193 time to create 1 rle with old method : 0.02989339828491211 length of segment : 272 time for calcul the mask position with numpy : 0.0009555816650390625 nb_pixel_total : 24706 time to create 1 rle with old method : 0.03222227096557617 length of segment : 225 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 42082 time to create 1 rle with old method : 0.04801225662231445 length of segment : 241 time for calcul the mask position with numpy : 0.0016772747039794922 nb_pixel_total : 69266 time to create 1 rle with old method : 0.07775115966796875 length of segment : 708 time for calcul the mask position with numpy : 0.0006310939788818359 nb_pixel_total : 18629 time to create 1 rle with old method : 0.020917654037475586 length of segment : 288 time for calcul the mask position with numpy : 0.0005011558532714844 nb_pixel_total : 17354 time to create 1 rle with old method : 0.019644975662231445 length of segment : 177 time for calcul the mask position with numpy : 0.0008726119995117188 nb_pixel_total : 27956 time to create 1 rle with old method : 0.031982421875 length of segment : 321 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 5488 time to create 1 rle with old method : 0.006651163101196289 length of segment : 68 time for calcul the mask position with numpy : 0.0018219947814941406 nb_pixel_total : 63916 time to create 1 rle with old method : 0.0717158317565918 length of segment : 227 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 34587 time to create 1 rle with old method : 0.039456844329833984 length of segment : 184 time for calcul the mask position with numpy : 0.0013885498046875 nb_pixel_total : 46326 time to create 1 rle with old method : 0.054168701171875 length of segment : 234 time for calcul the mask position with numpy : 0.0019338130950927734 nb_pixel_total : 61122 time to create 1 rle with old method : 0.06837320327758789 length of segment : 355 time for calcul the mask position with numpy : 0.003715991973876953 nb_pixel_total : 79249 time to create 1 rle with old method : 0.08981704711914062 length of segment : 568 time for calcul the mask position with numpy : 0.0004589557647705078 nb_pixel_total : 13125 time to create 1 rle with old method : 0.015207052230834961 length of segment : 104 time for calcul the mask position with numpy : 0.002826213836669922 nb_pixel_total : 116439 time to create 1 rle with old method : 0.13126921653747559 length of segment : 323 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 9271 time to create 1 rle with old method : 0.010708332061767578 length of segment : 122 time for calcul the mask position with numpy : 0.0030624866485595703 nb_pixel_total : 85538 time to create 1 rle with old method : 0.09763860702514648 length of segment : 378 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 13105 time to create 1 rle with old method : 0.01529240608215332 length of segment : 157 time spent for convertir_results : 15.8908109664917 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 164 chid ids of type : 3594 Number RLEs to save : 48502 save missing photos in datou_result : time spend for datou_step_exec : 85.82622694969177 time spend to save output : 6.9535932540893555 total time spend for step 1 : 92.77982020378113 step2:crop_condition Fri May 16 00:22:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 164 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 97 About to insert : list_path_to_insert length 97 new photo from crops ! About to upload 97 photos upload in portfolio : 3736932 init cache_photo without model_param we have 97 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747347753_1458622 we have uploaded 97 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.019681692123413 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747347783_1458622 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.629997491836548 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3736932 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747347806_1458622 we have uploaded 46 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.066882133483887 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747347822_1458622 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6000885963439941 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747347824_1458622 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6792535781860352 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358627706, 1358627677, 1358627646, 1358626081, 1358624618, 1358624552, 1358624490, 1358624420, 1358623771, 1358623712, 1358623661] Looping around the photos to save general results len do output : 164 /1358702705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358702871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358703164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627706', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627677', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627646', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358626081', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624618', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624552', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624490', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624420', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623771', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623712', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623661', None, None, None, None, None, '2869886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 503 time used for this insertion : 0.45819973945617676 save_final save missing photos in datou_result : time spend for datou_step_exec : 102.43312358856201 time spend to save output : 0.4624485969543457 total time spend for step 2 : 102.89557218551636 step3:rle_unique_nms_with_priority Fri May 16 00:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 164 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.831118583679199 time for calcul the mask position with numpy : 1.6784710884094238 nb_pixel_total : 6470178 time to create 1 rle with new method : 0.5113978385925293 time for calcul the mask position with numpy : 0.03449440002441406 nb_pixel_total : 34679 time to create 1 rle with old method : 0.03827691078186035 time for calcul the mask position with numpy : 0.03486943244934082 nb_pixel_total : 67855 time to create 1 rle with old method : 0.07340121269226074 time for calcul the mask position with numpy : 0.03343820571899414 nb_pixel_total : 6966 time to create 1 rle with old method : 0.008203744888305664 time for calcul the mask position with numpy : 0.03442549705505371 nb_pixel_total : 28680 time to create 1 rle with old method : 0.03229117393493652 time for calcul the mask position with numpy : 0.03824305534362793 nb_pixel_total : 25490 time to create 1 rle with old method : 0.02842426300048828 time for calcul the mask position with numpy : 0.034166812896728516 nb_pixel_total : 45030 time to create 1 rle with old method : 0.04980349540710449 time for calcul the mask position with numpy : 0.031183958053588867 nb_pixel_total : 51776 time to create 1 rle with old method : 0.05816507339477539 time for calcul the mask position with numpy : 0.023474931716918945 nb_pixel_total : 248697 time to create 1 rle with new method : 0.7470779418945312 time for calcul the mask position with numpy : 0.02193164825439453 nb_pixel_total : 51761 time to create 1 rle with old method : 0.05771207809448242 time for calcul the mask position with numpy : 0.021598339080810547 nb_pixel_total : 19128 time to create 1 rle with old method : 0.020665645599365234 create new chi : 3.670717716217041 time to delete rle : 0.02148270606994629 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 6631 TO DO : save crop sub photo not yet done ! save time : 1.9297199249267578 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 9.406072854995728 time for calcul the mask position with numpy : 1.3207552433013916 nb_pixel_total : 6371423 time to create 1 rle with new method : 0.772554874420166 time for calcul the mask position with numpy : 0.03504347801208496 nb_pixel_total : 10595 time to create 1 rle with old method : 0.011948108673095703 time for calcul the mask position with numpy : 0.03540992736816406 nb_pixel_total : 85107 time to create 1 rle with old method : 0.09379291534423828 time for calcul the mask position with numpy : 0.033597469329833984 nb_pixel_total : 73312 time to create 1 rle with old method : 0.08147263526916504 time for calcul the mask position with numpy : 0.020873308181762695 nb_pixel_total : 27011 time to create 1 rle with old method : 0.030284643173217773 time for calcul the mask position with numpy : 0.021929502487182617 nb_pixel_total : 19812 time to create 1 rle with old method : 0.022276878356933594 time for calcul the mask position with numpy : 0.02201080322265625 nb_pixel_total : 75538 time to create 1 rle with old method : 0.09160780906677246 time for calcul the mask position with numpy : 0.027128219604492188 nb_pixel_total : 16869 time to create 1 rle with old method : 0.028477191925048828 time for calcul the mask position with numpy : 0.04081988334655762 nb_pixel_total : 85361 time to create 1 rle with old method : 0.11472415924072266 time for calcul the mask position with numpy : 0.02724170684814453 nb_pixel_total : 16709 time to create 1 rle with old method : 0.01962757110595703 time for calcul the mask position with numpy : 0.02283310890197754 nb_pixel_total : 50949 time to create 1 rle with old method : 0.05701279640197754 time for calcul the mask position with numpy : 0.022841930389404297 nb_pixel_total : 98498 time to create 1 rle with old method : 0.1092216968536377 time for calcul the mask position with numpy : 0.02323007583618164 nb_pixel_total : 91825 time to create 1 rle with old method : 0.10086822509765625 time for calcul the mask position with numpy : 0.021504878997802734 nb_pixel_total : 27231 time to create 1 rle with old method : 0.03011775016784668 create new chi : 3.2823264598846436 time to delete rle : 0.0014882087707519531 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9396 TO DO : save crop sub photo not yet done ! save time : 1.8266005516052246 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 12.545395851135254 time for calcul the mask position with numpy : 1.9144079685211182 nb_pixel_total : 5982209 time to create 1 rle with new method : 1.7640223503112793 time for calcul the mask position with numpy : 0.02121138572692871 nb_pixel_total : 40747 time to create 1 rle with old method : 0.0453646183013916 time for calcul the mask position with numpy : 0.02161693572998047 nb_pixel_total : 5542 time to create 1 rle with old method : 0.006261587142944336 time for calcul the mask position with numpy : 0.03954958915710449 nb_pixel_total : 36776 time to create 1 rle with old method : 0.041074275970458984 time for calcul the mask position with numpy : 0.03880929946899414 nb_pixel_total : 211554 time to create 1 rle with new method : 0.941619873046875 time for calcul the mask position with numpy : 0.04004096984863281 nb_pixel_total : 149347 time to create 1 rle with old method : 0.17479276657104492 time for calcul the mask position with numpy : 0.03859114646911621 nb_pixel_total : 18016 time to create 1 rle with old method : 0.020209312438964844 time for calcul the mask position with numpy : 0.0370333194732666 nb_pixel_total : 7087 time to create 1 rle with old method : 0.007967710494995117 time for calcul the mask position with numpy : 0.036165714263916016 nb_pixel_total : 14655 time to create 1 rle with old method : 0.016538381576538086 time for calcul the mask position with numpy : 0.03483319282531738 nb_pixel_total : 47967 time to create 1 rle with old method : 0.05365610122680664 time for calcul the mask position with numpy : 0.03485822677612305 nb_pixel_total : 30588 time to create 1 rle with old method : 0.033724069595336914 time for calcul the mask position with numpy : 0.035719871520996094 nb_pixel_total : 44964 time to create 1 rle with old method : 0.049533843994140625 time for calcul the mask position with numpy : 0.025434255599975586 nb_pixel_total : 445168 time to create 1 rle with new method : 0.8969309329986572 time for calcul the mask position with numpy : 0.02172374725341797 nb_pixel_total : 15620 time to create 1 rle with old method : 0.01746082305908203 create new chi : 6.497967958450317 time to delete rle : 0.0015115737915039062 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 10518 TO DO : save crop sub photo not yet done ! save time : 1.9880201816558838 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 8.334859132766724 time for calcul the mask position with numpy : 1.4388625621795654 nb_pixel_total : 5404560 time to create 1 rle with new method : 2.4374895095825195 time for calcul the mask position with numpy : 0.021894454956054688 nb_pixel_total : 3776 time to create 1 rle with old method : 0.004599094390869141 time for calcul the mask position with numpy : 0.02174091339111328 nb_pixel_total : 117196 time to create 1 rle with old method : 0.13118243217468262 time for calcul the mask position with numpy : 0.022087574005126953 nb_pixel_total : 234671 time to create 1 rle with new method : 1.1941709518432617 time for calcul the mask position with numpy : 0.02103710174560547 nb_pixel_total : 28262 time to create 1 rle with old method : 0.0316309928894043 time for calcul the mask position with numpy : 0.021169185638427734 nb_pixel_total : 78123 time to create 1 rle with old method : 0.08913326263427734 time for calcul the mask position with numpy : 0.021114110946655273 nb_pixel_total : 89715 time to create 1 rle with old method : 0.09961247444152832 time for calcul the mask position with numpy : 0.022478818893432617 nb_pixel_total : 108032 time to create 1 rle with old method : 0.12573671340942383 time for calcul the mask position with numpy : 0.022029399871826172 nb_pixel_total : 103860 time to create 1 rle with old method : 0.11717414855957031 time for calcul the mask position with numpy : 0.0254666805267334 nb_pixel_total : 595211 time to create 1 rle with new method : 1.6019902229309082 time for calcul the mask position with numpy : 0.022200822830200195 nb_pixel_total : 107000 time to create 1 rle with old method : 0.11853814125061035 time for calcul the mask position with numpy : 0.022030353546142578 nb_pixel_total : 123772 time to create 1 rle with old method : 0.13565587997436523 time for calcul the mask position with numpy : 0.02338886260986328 nb_pixel_total : 56062 time to create 1 rle with old method : 0.08208680152893066 create new chi : 7.959527492523193 time to delete rle : 0.0020880699157714844 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 14509 TO DO : save crop sub photo not yet done ! save time : 2.7714359760284424 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 11.938147783279419 time for calcul the mask position with numpy : 1.5156028270721436 nb_pixel_total : 5628679 time to create 1 rle with new method : 1.5199790000915527 time for calcul the mask position with numpy : 0.02070021629333496 nb_pixel_total : 24662 time to create 1 rle with old method : 0.027561426162719727 time for calcul the mask position with numpy : 0.02041792869567871 nb_pixel_total : 27828 time to create 1 rle with old method : 0.030652999877929688 time for calcul the mask position with numpy : 0.020252466201782227 nb_pixel_total : 13167 time to create 1 rle with old method : 0.014575481414794922 time for calcul the mask position with numpy : 0.020600318908691406 nb_pixel_total : 22024 time to create 1 rle with old method : 0.026901721954345703 time for calcul the mask position with numpy : 0.021506786346435547 nb_pixel_total : 17301 time to create 1 rle with old method : 0.01915717124938965 time for calcul the mask position with numpy : 0.021211624145507812 nb_pixel_total : 14076 time to create 1 rle with old method : 0.015876054763793945 time for calcul the mask position with numpy : 0.021050214767456055 nb_pixel_total : 41637 time to create 1 rle with old method : 0.04619455337524414 time for calcul the mask position with numpy : 0.022133588790893555 nb_pixel_total : 139112 time to create 1 rle with old method : 0.1566321849822998 time for calcul the mask position with numpy : 0.023221731185913086 nb_pixel_total : 88110 time to create 1 rle with old method : 0.09878945350646973 time for calcul the mask position with numpy : 0.021510601043701172 nb_pixel_total : 75380 time to create 1 rle with old method : 0.08410477638244629 time for calcul the mask position with numpy : 0.021309852600097656 nb_pixel_total : 52221 time to create 1 rle with old method : 0.0598752498626709 time for calcul the mask position with numpy : 0.02146124839782715 nb_pixel_total : 38592 time to create 1 rle with old method : 0.04297924041748047 time for calcul the mask position with numpy : 0.020921945571899414 nb_pixel_total : 31713 time to create 1 rle with old method : 0.035202980041503906 time for calcul the mask position with numpy : 0.021894454956054688 nb_pixel_total : 77916 time to create 1 rle with old method : 0.09284710884094238 time for calcul the mask position with numpy : 0.0218658447265625 nb_pixel_total : 72263 time to create 1 rle with old method : 0.08182835578918457 time for calcul the mask position with numpy : 0.023366689682006836 nb_pixel_total : 213043 time to create 1 rle with new method : 0.4401733875274658 time for calcul the mask position with numpy : 0.022936582565307617 nb_pixel_total : 191655 time to create 1 rle with new method : 0.38663196563720703 time for calcul the mask position with numpy : 0.02245473861694336 nb_pixel_total : 139417 time to create 1 rle with old method : 0.15316319465637207 time for calcul the mask position with numpy : 0.0325465202331543 nb_pixel_total : 141444 time to create 1 rle with old method : 0.1745436191558838 create new chi : 5.530254125595093 time to delete rle : 0.002116680145263672 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 13316 TO DO : save crop sub photo not yet done ! save time : 1.7794485092163086 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 11.163220643997192 time for calcul the mask position with numpy : 1.2116844654083252 nb_pixel_total : 5789156 time to create 1 rle with new method : 2.0294008255004883 time for calcul the mask position with numpy : 0.02513575553894043 nb_pixel_total : 228415 time to create 1 rle with new method : 2.5403027534484863 time for calcul the mask position with numpy : 0.02221059799194336 nb_pixel_total : 31930 time to create 1 rle with old method : 0.03766942024230957 time for calcul the mask position with numpy : 0.02360820770263672 nb_pixel_total : 8191 time to create 1 rle with old method : 0.009080171585083008 time for calcul the mask position with numpy : 0.021384716033935547 nb_pixel_total : 17505 time to create 1 rle with old method : 0.018935441970825195 time for calcul the mask position with numpy : 0.022253036499023438 nb_pixel_total : 324848 time to create 1 rle with new method : 0.9463181495666504 time for calcul the mask position with numpy : 0.020636558532714844 nb_pixel_total : 42828 time to create 1 rle with old method : 0.04662752151489258 time for calcul the mask position with numpy : 0.027497291564941406 nb_pixel_total : 21689 time to create 1 rle with old method : 0.023514270782470703 time for calcul the mask position with numpy : 0.034186363220214844 nb_pixel_total : 298847 time to create 1 rle with new method : 0.8755795955657959 time for calcul the mask position with numpy : 0.029401302337646484 nb_pixel_total : 62318 time to create 1 rle with old method : 0.0686500072479248 time for calcul the mask position with numpy : 0.021759033203125 nb_pixel_total : 43450 time to create 1 rle with old method : 0.048166751861572266 time for calcul the mask position with numpy : 0.022558927536010742 nb_pixel_total : 23620 time to create 1 rle with old method : 0.025312185287475586 time for calcul the mask position with numpy : 0.021644115447998047 nb_pixel_total : 61624 time to create 1 rle with old method : 0.06561017036437988 time for calcul the mask position with numpy : 0.021225690841674805 nb_pixel_total : 15804 time to create 1 rle with old method : 0.01724982261657715 time for calcul the mask position with numpy : 0.020959854125976562 nb_pixel_total : 33626 time to create 1 rle with old method : 0.03635883331298828 time for calcul the mask position with numpy : 0.021554231643676758 nb_pixel_total : 46389 time to create 1 rle with old method : 0.051136016845703125 create new chi : 8.521575212478638 time to delete rle : 0.0015916824340820312 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 11110 TO DO : save crop sub photo not yet done ! save time : 1.1008594036102295 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 12.299299478530884 time for calcul the mask position with numpy : 1.1131823062896729 nb_pixel_total : 6203981 time to create 1 rle with new method : 0.37094783782958984 time for calcul the mask position with numpy : 0.02119612693786621 nb_pixel_total : 28377 time to create 1 rle with old method : 0.031133413314819336 time for calcul the mask position with numpy : 0.02160334587097168 nb_pixel_total : 26182 time to create 1 rle with old method : 0.02951836585998535 time for calcul the mask position with numpy : 0.031196117401123047 nb_pixel_total : 60060 time to create 1 rle with old method : 0.06685829162597656 time for calcul the mask position with numpy : 0.034388065338134766 nb_pixel_total : 39570 time to create 1 rle with old method : 0.04393458366394043 time for calcul the mask position with numpy : 0.03378009796142578 nb_pixel_total : 34532 time to create 1 rle with old method : 0.03867459297180176 time for calcul the mask position with numpy : 0.03175187110900879 nb_pixel_total : 101752 time to create 1 rle with old method : 0.11819052696228027 time for calcul the mask position with numpy : 0.023215055465698242 nb_pixel_total : 23599 time to create 1 rle with old method : 0.026389122009277344 time for calcul the mask position with numpy : 0.02232503890991211 nb_pixel_total : 9499 time to create 1 rle with old method : 0.010766983032226562 time for calcul the mask position with numpy : 0.022826433181762695 nb_pixel_total : 21998 time to create 1 rle with old method : 0.024446725845336914 time for calcul the mask position with numpy : 0.021526575088500977 nb_pixel_total : 94447 time to create 1 rle with old method : 0.10527944564819336 time for calcul the mask position with numpy : 0.022785186767578125 nb_pixel_total : 51250 time to create 1 rle with old method : 0.058016300201416016 time for calcul the mask position with numpy : 0.022210121154785156 nb_pixel_total : 21064 time to create 1 rle with old method : 0.023637056350708008 time for calcul the mask position with numpy : 0.02286553382873535 nb_pixel_total : 34495 time to create 1 rle with old method : 0.039038658142089844 time for calcul the mask position with numpy : 0.022275686264038086 nb_pixel_total : 32021 time to create 1 rle with old method : 0.03621673583984375 time for calcul the mask position with numpy : 0.023978233337402344 nb_pixel_total : 53465 time to create 1 rle with old method : 0.062285661697387695 time for calcul the mask position with numpy : 0.022013425827026367 nb_pixel_total : 15185 time to create 1 rle with old method : 0.017055749893188477 time for calcul the mask position with numpy : 0.02214980125427246 nb_pixel_total : 17737 time to create 1 rle with old method : 0.019837379455566406 time for calcul the mask position with numpy : 0.0213625431060791 nb_pixel_total : 30901 time to create 1 rle with old method : 0.03447461128234863 time for calcul the mask position with numpy : 0.02157306671142578 nb_pixel_total : 8562 time to create 1 rle with old method : 0.009592771530151367 time for calcul the mask position with numpy : 0.021691322326660156 nb_pixel_total : 34857 time to create 1 rle with old method : 0.03876662254333496 time for calcul the mask position with numpy : 0.022237062454223633 nb_pixel_total : 25563 time to create 1 rle with old method : 0.03538918495178223 time for calcul the mask position with numpy : 0.023293733596801758 nb_pixel_total : 12474 time to create 1 rle with old method : 0.028481006622314453 time for calcul the mask position with numpy : 0.027363300323486328 nb_pixel_total : 68669 time to create 1 rle with old method : 0.08539032936096191 create new chi : 3.065838575363159 time to delete rle : 0.0019178390502929688 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 12274 TO DO : save crop sub photo not yet done ! save time : 1.4345262050628662 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 13.673497915267944 time for calcul the mask position with numpy : 0.66019606590271 nb_pixel_total : 5585263 time to create 1 rle with new method : 0.9275150299072266 time for calcul the mask position with numpy : 0.03742718696594238 nb_pixel_total : 292985 time to create 1 rle with new method : 0.7097973823547363 time for calcul the mask position with numpy : 0.04659771919250488 nb_pixel_total : 16990 time to create 1 rle with old method : 0.025180339813232422 time for calcul the mask position with numpy : 0.03882265090942383 nb_pixel_total : 109160 time to create 1 rle with old method : 0.12544870376586914 time for calcul the mask position with numpy : 0.025524616241455078 nb_pixel_total : 92006 time to create 1 rle with old method : 0.11828875541687012 time for calcul the mask position with numpy : 0.023667335510253906 nb_pixel_total : 102443 time to create 1 rle with old method : 0.11919546127319336 time for calcul the mask position with numpy : 0.02239847183227539 nb_pixel_total : 14463 time to create 1 rle with old method : 0.016484737396240234 time for calcul the mask position with numpy : 0.024030208587646484 nb_pixel_total : 122039 time to create 1 rle with old method : 0.15647387504577637 time for calcul the mask position with numpy : 0.027297258377075195 nb_pixel_total : 20587 time to create 1 rle with old method : 0.024782896041870117 time for calcul the mask position with numpy : 0.03639650344848633 nb_pixel_total : 40864 time to create 1 rle with old method : 0.04594612121582031 time for calcul the mask position with numpy : 0.0389094352722168 nb_pixel_total : 80991 time to create 1 rle with old method : 0.09044075012207031 time for calcul the mask position with numpy : 0.03522229194641113 nb_pixel_total : 87493 time to create 1 rle with old method : 0.09730005264282227 time for calcul the mask position with numpy : 0.03517961502075195 nb_pixel_total : 5226 time to create 1 rle with old method : 0.005876302719116211 time for calcul the mask position with numpy : 0.0361328125 nb_pixel_total : 21821 time to create 1 rle with old method : 0.024317026138305664 time for calcul the mask position with numpy : 0.03721451759338379 nb_pixel_total : 18456 time to create 1 rle with old method : 0.02062535285949707 time for calcul the mask position with numpy : 0.03966379165649414 nb_pixel_total : 32403 time to create 1 rle with old method : 0.03954648971557617 time for calcul the mask position with numpy : 0.03590679168701172 nb_pixel_total : 39240 time to create 1 rle with old method : 0.04564976692199707 time for calcul the mask position with numpy : 0.035961151123046875 nb_pixel_total : 11504 time to create 1 rle with old method : 0.013216257095336914 time for calcul the mask position with numpy : 0.03612875938415527 nb_pixel_total : 56410 time to create 1 rle with old method : 0.06305670738220215 time for calcul the mask position with numpy : 0.03486800193786621 nb_pixel_total : 36112 time to create 1 rle with old method : 0.040276527404785156 time for calcul the mask position with numpy : 0.03652691841125488 nb_pixel_total : 182929 time to create 1 rle with new method : 0.6816647052764893 time for calcul the mask position with numpy : 0.03403663635253906 nb_pixel_total : 27036 time to create 1 rle with old method : 0.03037858009338379 time for calcul the mask position with numpy : 0.03093433380126953 nb_pixel_total : 53819 time to create 1 rle with old method : 0.05975699424743652 create new chi : 4.982091903686523 time to delete rle : 0.004985809326171875 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 16602 TO DO : save crop sub photo not yet done ! save time : 2.5668675899505615 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 8.749647378921509 time for calcul the mask position with numpy : 0.9321026802062988 nb_pixel_total : 6697553 time to create 1 rle with new method : 1.5675115585327148 time for calcul the mask position with numpy : 0.03588700294494629 nb_pixel_total : 36030 time to create 1 rle with old method : 0.040252685546875 time for calcul the mask position with numpy : 0.03535294532775879 nb_pixel_total : 48790 time to create 1 rle with old method : 0.05428576469421387 time for calcul the mask position with numpy : 0.03474903106689453 nb_pixel_total : 14839 time to create 1 rle with old method : 0.016597509384155273 time for calcul the mask position with numpy : 0.03547406196594238 nb_pixel_total : 17709 time to create 1 rle with old method : 0.019737720489501953 time for calcul the mask position with numpy : 0.03765439987182617 nb_pixel_total : 20769 time to create 1 rle with old method : 0.028903484344482422 time for calcul the mask position with numpy : 0.036942243576049805 nb_pixel_total : 19446 time to create 1 rle with old method : 0.022027969360351562 time for calcul the mask position with numpy : 0.026708602905273438 nb_pixel_total : 14980 time to create 1 rle with old method : 0.016818523406982422 time for calcul the mask position with numpy : 0.025623321533203125 nb_pixel_total : 15478 time to create 1 rle with old method : 0.017726898193359375 time for calcul the mask position with numpy : 0.02196025848388672 nb_pixel_total : 57655 time to create 1 rle with old method : 0.06394124031066895 time for calcul the mask position with numpy : 0.02120375633239746 nb_pixel_total : 75199 time to create 1 rle with old method : 0.08396553993225098 time for calcul the mask position with numpy : 0.021147489547729492 nb_pixel_total : 31792 time to create 1 rle with old method : 0.035598039627075195 create new chi : 3.2731635570526123 time to delete rle : 0.0012729167938232422 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6727 TO DO : save crop sub photo not yet done ! save time : 0.5463047027587891 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 11.130614042282104 time for calcul the mask position with numpy : 1.0803327560424805 nb_pixel_total : 6512591 time to create 1 rle with new method : 2.057224988937378 time for calcul the mask position with numpy : 0.03377795219421387 nb_pixel_total : 5488 time to create 1 rle with old method : 0.006116151809692383 time for calcul the mask position with numpy : 0.03330373764038086 nb_pixel_total : 27956 time to create 1 rle with old method : 0.03031468391418457 time for calcul the mask position with numpy : 0.03293347358703613 nb_pixel_total : 17354 time to create 1 rle with old method : 0.018056631088256836 time for calcul the mask position with numpy : 0.03256487846374512 nb_pixel_total : 18629 time to create 1 rle with old method : 0.01971268653869629 time for calcul the mask position with numpy : 0.0340731143951416 nb_pixel_total : 69266 time to create 1 rle with old method : 0.07663178443908691 time for calcul the mask position with numpy : 0.03539395332336426 nb_pixel_total : 42082 time to create 1 rle with old method : 0.046436309814453125 time for calcul the mask position with numpy : 0.039415597915649414 nb_pixel_total : 24640 time to create 1 rle with old method : 0.027085065841674805 time for calcul the mask position with numpy : 0.03320574760437012 nb_pixel_total : 26193 time to create 1 rle with old method : 0.028395891189575195 time for calcul the mask position with numpy : 0.0329434871673584 nb_pixel_total : 12413 time to create 1 rle with old method : 0.013490438461303711 time for calcul the mask position with numpy : 0.020827054977416992 nb_pixel_total : 17492 time to create 1 rle with old method : 0.019105911254882812 time for calcul the mask position with numpy : 0.03387856483459473 nb_pixel_total : 9229 time to create 1 rle with old method : 0.01016855239868164 time for calcul the mask position with numpy : 0.035855770111083984 nb_pixel_total : 190761 time to create 1 rle with new method : 1.4056415557861328 time for calcul the mask position with numpy : 0.03304243087768555 nb_pixel_total : 15097 time to create 1 rle with old method : 0.01661539077758789 time for calcul the mask position with numpy : 0.034319162368774414 nb_pixel_total : 25485 time to create 1 rle with old method : 0.02890920639038086 time for calcul the mask position with numpy : 0.03342723846435547 nb_pixel_total : 16099 time to create 1 rle with old method : 0.017588138580322266 time for calcul the mask position with numpy : 0.03134584426879883 nb_pixel_total : 19465 time to create 1 rle with old method : 0.021498918533325195 create new chi : 5.513601541519165 time to delete rle : 0.0015897750854492188 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 9902 TO DO : save crop sub photo not yet done ! save time : 2.1390130519866943 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 8.241453170776367 time for calcul the mask position with numpy : 1.0104930400848389 nb_pixel_total : 6527562 time to create 1 rle with new method : 1.7380809783935547 time for calcul the mask position with numpy : 0.03471064567565918 nb_pixel_total : 13105 time to create 1 rle with old method : 0.014662742614746094 time for calcul the mask position with numpy : 0.034708261489868164 nb_pixel_total : 85538 time to create 1 rle with old method : 0.09232759475708008 time for calcul the mask position with numpy : 0.033899545669555664 nb_pixel_total : 9271 time to create 1 rle with old method : 0.010179758071899414 time for calcul the mask position with numpy : 0.03838467597961426 nb_pixel_total : 116439 time to create 1 rle with old method : 0.1428239345550537 time for calcul the mask position with numpy : 0.0212857723236084 nb_pixel_total : 13125 time to create 1 rle with old method : 0.014416933059692383 time for calcul the mask position with numpy : 0.021448373794555664 nb_pixel_total : 79249 time to create 1 rle with old method : 0.08761167526245117 time for calcul the mask position with numpy : 0.021712303161621094 nb_pixel_total : 61122 time to create 1 rle with old method : 0.07227826118469238 time for calcul the mask position with numpy : 0.02141594886779785 nb_pixel_total : 46326 time to create 1 rle with old method : 0.05082368850708008 time for calcul the mask position with numpy : 0.0205385684967041 nb_pixel_total : 34587 time to create 1 rle with old method : 0.038588762283325195 time for calcul the mask position with numpy : 0.02196335792541504 nb_pixel_total : 63916 time to create 1 rle with old method : 0.07658219337463379 create new chi : 3.6576266288757324 time to delete rle : 0.0012679100036621094 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7464 TO DO : save crop sub photo not yet done ! save time : 0.7908072471618652 map_output_result : {1358627706: (0.0, 'Should be the crop_list due to order', 0), 1358627677: (0.0, 'Should be the crop_list due to order', 0), 1358627646: (0.0, 'Should be the crop_list due to order', 0), 1358626081: (0.0, 'Should be the crop_list due to order', 0), 1358624618: (0.0, 'Should be the crop_list due to order', 0), 1358624552: (0.0, 'Should be the crop_list due to order', 0), 1358624490: (0.0, 'Should be the crop_list due to order', 0), 1358624420: (0.0, 'Should be the crop_list due to order', 0), 1358623771: (0.0, 'Should be the crop_list due to order', 0), 1358623712: (0.0, 'Should be the crop_list due to order', 0), 1358623661: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358627706, 1358627677, 1358627646, 1358626081, 1358624618, 1358624552, 1358624490, 1358624420, 1358623771, 1358623712, 1358623661] Looping around the photos to save general results len do output : 11 /1358627706.Didn't retrieve data . /1358627677.Didn't retrieve data . /1358627646.Didn't retrieve data . /1358626081.Didn't retrieve data . /1358624618.Didn't retrieve data . /1358624552.Didn't retrieve data . /1358624490.Didn't retrieve data . /1358624420.Didn't retrieve data . /1358623771.Didn't retrieve data . /1358623712.Didn't retrieve data . /1358623661.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627706', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627677', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627646', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358626081', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624618', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624552', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624490', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624420', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623771', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623712', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623661', None, None, None, None, None, '2869886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01515340805053711 save_final save missing photos in datou_result : time spend for datou_step_exec : 189.36811876296997 time spend to save output : 0.015569448471069336 total time spend for step 3 : 189.38368821144104 step4:ventilate_hashtags_in_portfolio Fri May 16 00:26:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23035151 get user id for portfolio 23035151 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23035151 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','autre','pet_fonce','environnement','background','papier','carton','flou','mal_croppe','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23035151 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','autre','pet_fonce','environnement','background','papier','carton','flou','mal_croppe','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23035151 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','autre','pet_fonce','environnement','background','papier','carton','flou','mal_croppe','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23035847,23035848,23035849,23035850,23035851,23035852,23035853,23035854,23035855,23035856,23035857?tags=pet_clair,metal,autre,pet_fonce,environnement,background,papier,carton,flou,mal_croppe,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358627706, 1358627677, 1358627646, 1358626081, 1358624618, 1358624552, 1358624490, 1358624420, 1358623771, 1358623712, 1358623661] Looping around the photos to save general results len do output : 1 /23035151. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627706', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627677', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627646', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358626081', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624618', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624552', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624490', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624420', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623771', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623712', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623661', None, None, None, None, None, '2869886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01760101318359375 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.083099365234375 time spend to save output : 0.017886638641357422 total time spend for step 4 : 2.1009860038757324 step5:final Fri May 16 00:26:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358627706: ('0.13383793253201948',), 1358627677: ('0.13383793253201948',), 1358627646: ('0.13383793253201948',), 1358626081: ('0.13383793253201948',), 1358624618: ('0.13383793253201948',), 1358624552: ('0.13383793253201948',), 1358624490: ('0.13383793253201948',), 1358624420: ('0.13383793253201948',), 1358623771: ('0.13383793253201948',), 1358623712: ('0.13383793253201948',), 1358623661: ('0.13383793253201948',)} new output for save of step final : {1358627706: ('0.13383793253201948',), 1358627677: ('0.13383793253201948',), 1358627646: ('0.13383793253201948',), 1358626081: ('0.13383793253201948',), 1358624618: ('0.13383793253201948',), 1358624552: ('0.13383793253201948',), 1358624490: ('0.13383793253201948',), 1358624420: ('0.13383793253201948',), 1358623771: ('0.13383793253201948',), 1358623712: ('0.13383793253201948',), 1358623661: ('0.13383793253201948',)} [1358627706, 1358627677, 1358627646, 1358626081, 1358624618, 1358624552, 1358624490, 1358624420, 1358623771, 1358623712, 1358623661] Looping around the photos to save general results len do output : 11 /1358627706.Didn't retrieve data . /1358627677.Didn't retrieve data . /1358627646.Didn't retrieve data . /1358626081.Didn't retrieve data . /1358624618.Didn't retrieve data . /1358624552.Didn't retrieve data . /1358624490.Didn't retrieve data . /1358624420.Didn't retrieve data . /1358623771.Didn't retrieve data . /1358623712.Didn't retrieve data . /1358623661.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627706', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627677', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627646', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358626081', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624618', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624552', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624490', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624420', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623771', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623712', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623661', None, None, None, None, None, '2869886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013722658157348633 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11652445793151855 time spend to save output : 0.014075040817260742 total time spend for step 5 : 0.1305994987487793 step6:blur_detection Fri May 16 00:26:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab.jpg resize: (2160, 3264) 1358627706 0.8088699324232258 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d.jpg resize: (2160, 3264) 1358627677 0.7423897995245935 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491.jpg resize: (2160, 3264) 1358627646 -1.2336401647126656 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3.jpg resize: (2160, 3264) 1358626081 -0.24869113135955861 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d.jpg resize: (2160, 3264) 1358624618 -1.6954472434856207 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860.jpg resize: (2160, 3264) 1358624552 1.3147092104406903 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322.jpg resize: (2160, 3264) 1358624490 -3.293269568595424 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269.jpg resize: (2160, 3264) 1358624420 0.06328245671795285 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f.jpg resize: (2160, 3264) 1358623771 -0.5426721888227046 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5.jpg resize: (2160, 3264) 1358623712 -3.4174572669085035 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01.jpg resize: (2160, 3264) 1358623661 -1.4374361439703753 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191532_0.png resize: (188, 527) 1358702705 0.30920031771857354 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191528_0.png resize: (226, 254) 1358702707 -1.2078506706931735 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191524_0.png resize: (148, 185) 1358702708 -0.30629310415421634 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191525_0.png resize: (221, 439) 1358702709 -0.5817442553915869 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191527_0.png resize: (238, 341) 1358702711 0.41734857467270126 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191533_0.png resize: (207, 237) 1358702712 -0.2199621056104707 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191531_0.png resize: (486, 630) 1358702713 -1.1598395629443272 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191534_0.png resize: (196, 201) 1358702714 -1.3839947210195636 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191544_0.png resize: (291, 437) 1358702715 -1.9272658007415495 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191539_0.png resize: (309, 459) 1358702716 -0.4556077640338271 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191538_0.png resize: (280, 139) 1358702717 -1.3476853612908166 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191536_0.png resize: (366, 414) 1358702718 0.737567543068364 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191541_0.png resize: (283, 405) 1358702719 -1.512568128085249 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191537_0.png resize: (350, 192) 1358702720 -0.9057862563578256 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191548_0.png resize: (1180, 515) 1358702721 0.013152369414742841 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191552_0.png resize: (132, 199) 1358702722 -1.667405149522351 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191558_0.png resize: (100, 80) 1358702723 -1.4576315558454616 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191547_0.png resize: (207, 159) 1358702724 -1.3929136655805103 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191551_0.png resize: (232, 265) 1358702725 1.395115678153947 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191553_0.png resize: (142, 143) 1358702726 0.2692685764760237 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191554_0.png resize: (210, 145) 1358702727 -1.6753375281749157 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191562_0.png resize: (374, 419) 1358702728 -1.026728540470038 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191561_0.png resize: (401, 443) 1358702729 -1.0187741802364745 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191560_0.png resize: (216, 435) 1358702730 -1.713321887724072 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191564_0.png resize: (323, 510) 1358702731 -1.1548750929645142 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191563_0.png resize: (492, 1408) 1358702732 -0.18635082588914106 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191565_0.png resize: (563, 393) 1358702733 -1.0295375148737977 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191570_0.png resize: (813, 371) 1358702734 -0.39318508882648173 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191569_0.png resize: (707, 659) 1358702735 -0.9769096228952232 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191567_0.png resize: (362, 260) 1358702736 -0.1417031415181383 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191568_0.png resize: (306, 113) 1358702737 -0.2741256707760582 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191578_0.png resize: (217, 178) 1358702738 -0.529404718329627 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191572_0.png resize: (446, 422) 1358702739 -1.0143738978377186 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191588_0.png resize: (153, 126) 1358702740 -3.271819200899875 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191576_0.png resize: (328, 487) 1358702741 -0.8011115723488758 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191584_0.png resize: (168, 449) 1358702742 -2.4822598036323336 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191577_0.png resize: (198, 515) 1358702743 -3.1182873446747403 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191585_0.png resize: (128, 174) 1358702744 -1.287797437151307 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191573_0.png resize: (393, 619) 1358702745 -1.3234848131517145 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191579_0.png resize: (204, 245) 1358702746 -1.352310893905426 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191587_0.png resize: (234, 140) 1358702747 -1.779413148565832 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191598_0.png resize: (870, 450) 1358702748 -0.6281467172846849 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191592_0.png resize: (228, 215) 1358702749 -1.56216207364787 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191601_0.png resize: (550, 861) 1358702750 -0.37965978727135696 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191596_0.png resize: (189, 286) 1358702751 0.006759767452406434 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191604_0.png resize: (170, 280) 1358702752 -1.6608941461015294 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191591_0.png resize: (214, 339) 1358702753 1.0312321920619478 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191603_0.png resize: (106, 110) 1358702754 -0.3621464890226214 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191599_0.png resize: (292, 152) 1358702755 -0.916771578786882 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191617_0.png resize: (169, 163) 1358702756 -0.9127087232237305 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191610_0.png resize: (76, 147) 1358702758 -0.208762540136632 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191623_0.png resize: (432, 336) 1358702759 -0.773203656062916 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191611_0.png resize: (219, 209) 1358702760 -1.3282401749101538 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191613_0.png resize: (123, 156) 1358702761 -0.6030597398471749 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191614_0.png resize: (392, 185) 1358702762 -3.1980399894213627 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191618_0.png resize: (257, 279) 1358702763 -3.299260994232035 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191621_0.png resize: (117, 119) 1358702764 -1.0477439416139387 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191622_0.png resize: (187, 154) 1358702765 -1.8609490601159135 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191620_0.png resize: (143, 205) 1358702767 -3.133902507263441 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191630_0.png resize: (201, 182) 1358702768 -1.1870536608073872 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191639_0.png resize: (111, 67) 1358702769 -1.3596367959700684 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191650_0.png resize: (992, 353) 1358702771 -1.4119291852529927 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191643_0.png resize: (214, 160) 1358702773 -2.31889955387556 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191645_0.png resize: (273, 145) 1358702774 -3.1691499169618256 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191646_0.png resize: (481, 290) 1358702775 -1.4998594443960889 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191629_0.png resize: (334, 279) 1358702776 -1.1314752339970697 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191634_0.png resize: (83, 177) 1358702777 0.1927187461377479 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191636_0.png resize: (145, 329) 1358702778 -1.3064144524667172 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191632_0.png resize: (250, 234) 1358702779 -1.398100690878356 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191637_0.png resize: (114, 221) 1358702780 -1.158759907074667 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191642_0.png resize: (205, 391) 1358702781 -1.73279784424004 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191638_0.png resize: (166, 175) 1358702782 -1.2415004535387704 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191633_0.png resize: (288, 306) 1358702783 -1.0964997919665342 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191635_0.png resize: (227, 217) 1358702784 -1.0051546956235147 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191649_0.png resize: (240, 100) 1358702785 -0.9560179082582817 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191659_0.png resize: (109, 197) 1358702786 -1.993176644009406 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191654_0.png resize: (129, 167) 1358702787 -1.139897823994008 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191651_0.png resize: (166, 279) 1358702788 -0.9010936880282396 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191655_0.png resize: (99, 202) 1358702789 0.2432457340241833 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191656_0.png resize: (194, 161) 1358702790 -0.11228059042934349 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191652_0.png resize: (300, 333) 1358702791 0.08333687429571167 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191657_0.png resize: (198, 163) 1358702792 -1.678103270155906 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191675_0.png resize: (175, 132) 1358702793 -1.5155364143858014 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191665_0.png resize: (115, 173) 1358702794 -0.7563295401467914 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191671_0.png resize: (184, 266) 1358702795 -2.337106152996471 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191663_0.png resize: (113, 190) 1358702796 -0.6706387891001526 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191669_0.png resize: (100, 223) 1358702798 -2.3053088898112515 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191677_0.png resize: (70, 132) 1358702799 -2.2106261452519798 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191664_0.png resize: (178, 200) 1358702800 -0.368115124117255 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191662_0.png resize: (169, 282) 1358702801 -0.8585564785445577 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191670_0.png resize: (247, 161) 1358702802 -2.1956101906414753 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191667_0.png resize: (125, 112) 1358702803 -0.7970120198302617 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191685_0.png resize: (122, 96) 1358702804 -0.3879682867361928 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191682_0.png resize: (583, 305) 1358702805 -1.5134532397034226 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191680_0.png resize: (234, 280) 1358702806 -0.5487677249836772 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191687_0.png resize: (157, 136) 1358702807 -1.8306719262511677 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191686_0.png resize: (376, 398) 1358702808 -0.5794451731664143 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191529_0.png resize: (152, 290) 1358702850 -1.8487794555190311 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191530_0.png resize: (201, 208) 1358702851 -0.43719612728894997 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191549_0.png resize: (319, 248) 1358702853 -0.5137470913151571 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191571_0.png resize: (743, 387) 1358702854 -0.4165707007715624 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191586_0.png resize: (147, 161) 1358702855 -1.1394561954302893 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191590_0.png resize: (177, 249) 1358702856 -1.4052780335677701 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191602_0.png resize: (161, 174) 1358702858 -0.022104579926321425 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191593_0.png resize: (92, 237) 1358702859 -0.6573814749154119 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191625_0.png resize: (236, 240) 1358702860 -1.1158138182727284 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191615_0.png resize: (249, 196) 1358702861 -1.5108505121641107 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191608_0.png resize: (208, 216) 1358702862 -1.389668927305609 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191612_0.png resize: (105, 261) 1358702863 -0.9758516073925233 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191607_0.png resize: (127, 135) 1358702864 -1.8745142518715139 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191628_0.png resize: (228, 255) 1358702865 -1.0243031326367893 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191647_0.png resize: (303, 461) 1358702867 -1.4353532743883561 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191658_0.png resize: (192, 138) 1358702868 -1.132788365331756 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191674_0.png resize: (261, 116) 1358702869 -1.9069575845679017 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191668_0.png resize: (187, 142) 1358702870 -1.8396713904055373 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191679_0.png resize: (183, 252) 1358702871 -0.5611434596330512 treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191526_0.png resize: (467, 645) 1358703073 -0.9684200031821628 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191535_0.png resize: (182, 823) 1358703074 0.6234301243447707 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191540_0.png resize: (81, 247) 1358703076 0.5237903603634451 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191543_0.png resize: (166, 189) 1358703077 -0.10410051542459671 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191546_0.png resize: (141, 111) 1358703078 -0.1800075936906769 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191545_0.png resize: (396, 317) 1358703080 -1.492065710387749 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191556_0.png resize: (422, 711) 1358703081 -0.6759819883032498 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191555_0.png resize: (368, 589) 1358703082 -0.7593424840157859 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191557_0.png resize: (226, 190) 1358703084 -4.025373396834794 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191559_0.png resize: (312, 181) 1358703085 -1.1675165747876273 treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191550_0.png resize: (290, 171) 1358703086 -1.6072610422794609 treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191566_0.png resize: (327, 406) 1358703088 -2.0096392388083135 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191575_0.png resize: (544, 715) 1358703089 -1.7098761433595155 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191581_0.png resize: (319, 471) 1358703090 -2.2282700790154464 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191574_0.png resize: (295, 887) 1358703092 -1.9056486748659458 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191582_0.png resize: (320, 380) 1358703093 -2.010045111084165 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191589_0.png resize: (175, 239) 1358703094 -3.413832892227709 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191583_0.png resize: (583, 392) 1358703095 -1.7075415056878438 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191594_0.png resize: (318, 264) 1358703097 -0.7148820240173265 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191600_0.png resize: (357, 237) 1358703099 -1.400036432629609 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191595_0.png resize: (177, 171) 1358703100 -1.2865465895271246 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191605_0.png resize: (445, 594) 1358703102 0.7955772739685522 treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191597_0.png resize: (214, 439) 1358703103 -0.6445565359558119 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191624_0.png resize: (140, 320) 1358703104 -1.029594008876751 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191627_0.png resize: (187, 203) 1358703106 -3.060281387650512 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191609_0.png resize: (182, 271) 1358703107 -1.6475861032768624 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191616_0.png resize: (203, 214) 1358703108 -1.8855492349504233 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191626_0.png resize: (278, 271) 1358703109 -0.45215968629583486 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191619_0.png resize: (290, 432) 1358703111 -3.289429455381457 treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191606_0.png resize: (343, 272) 1358703112 -1.2802976670127364 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191640_0.png resize: (447, 242) 1358703113 -1.1715702727077555 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191644_0.png resize: (288, 767) 1358703115 -1.3878283690128013 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191631_0.png resize: (396, 763) 1358703116 -1.6684001928736312 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191641_0.png resize: (390, 263) 1358703117 -2.09535860729927 treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191648_0.png resize: (267, 500) 1358703119 -0.4490706109122003 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191653_0.png resize: (290, 284) 1358703120 -0.9564832491693854 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191660_0.png resize: (281, 211) 1358703121 -0.3473277510818323 treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191661_0.png resize: (180, 237) 1358703122 -1.450740706534781 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191676_0.png resize: (262, 202) 1358703124 -3.045002936636639 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191666_0.png resize: (488, 584) 1358703125 -2.968290697407494 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191672_0.png resize: (182, 349) 1358703126 -1.800805487761748 treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191673_0.png resize: (381, 309) 1358703128 -3.0543045463864615 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191678_0.png resize: (212, 398) 1358703129 -1.8046233120370576 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191684_0.png resize: (323, 493) 1358703130 -0.21325393957777083 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191683_0.png resize: (104, 156) 1358703132 -2.6666866347342326 treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191681_0.png resize: (252, 409) 1358703133 -4.166713675512297 treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191542_0.png resize: (156, 160) 1358703147 0.08251258805556945 treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191580_0.png resize: (280, 245) 1358703164 -1.1749010098069843 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 175 time used for this insertion : 0.020586729049682617 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 175 time used for this insertion : 0.7302896976470947 save missing photos in datou_result : time spend for datou_step_exec : 40.81606364250183 time spend to save output : 0.7562055587768555 total time spend for step 6 : 41.57226920127869 step7:brightness Fri May 16 00:27:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab.jpg treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d.jpg treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491.jpg treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3.jpg treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d.jpg treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860.jpg treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322.jpg treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269.jpg treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f.jpg treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5.jpg treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01.jpg treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191532_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191528_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191524_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191525_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191527_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191533_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191531_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191534_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191544_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191539_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191538_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191536_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191541_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191537_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191548_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191552_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191558_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191547_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191551_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191553_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191554_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191562_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191561_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191560_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191564_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191563_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191565_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191570_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191569_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191567_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191568_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191578_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191572_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191588_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191576_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191584_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191577_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191585_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191573_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191579_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191587_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191598_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191592_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191601_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191596_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191604_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191591_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191603_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191599_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191617_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191610_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191623_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191611_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191613_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191614_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191618_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191621_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191622_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191620_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191630_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191639_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191650_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191643_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191645_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191646_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191629_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191634_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191636_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191632_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191637_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191642_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191638_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191633_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191635_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191649_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191659_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191654_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191651_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191655_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191656_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191652_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191657_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191675_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191665_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191671_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191663_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191669_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191677_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191664_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191662_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191670_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191667_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191685_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191682_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191680_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191687_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191686_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191529_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191530_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191549_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191571_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191586_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191590_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191602_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191593_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191625_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191615_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191608_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191612_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191607_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191628_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191647_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191658_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191674_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191668_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191679_0.png treat image : temp/1747347627_1458622_1358627706_f9822ef25d7c797c08f8ba681016c4ab_rle_crop_3800191526_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191535_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191540_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191543_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191546_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191545_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191556_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191555_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191557_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191559_0.png treat image : temp/1747347627_1458622_1358627646_976c8418566623d566c9ac58361c4491_rle_crop_3800191550_0.png treat image : temp/1747347627_1458622_1358626081_e09ac8675dc60af5aef92636400a95a3_rle_crop_3800191566_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191575_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191581_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191574_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191582_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191589_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191583_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191594_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191600_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191595_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191605_0.png treat image : temp/1747347627_1458622_1358624552_eca4c66de9c8d5800b7eb318faf74860_rle_crop_3800191597_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191624_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191627_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191609_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191616_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191626_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191619_0.png treat image : temp/1747347627_1458622_1358624490_14fdfe73ae43b3e3f5070765a165a322_rle_crop_3800191606_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191640_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191644_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191631_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191641_0.png treat image : temp/1747347627_1458622_1358624420_f3a4a530569a51c53faed7a923678269_rle_crop_3800191648_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191653_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191660_0.png treat image : temp/1747347627_1458622_1358623771_5ff2c62fea1749ba786850ec9a32176f_rle_crop_3800191661_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191676_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191666_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191672_0.png treat image : temp/1747347627_1458622_1358623712_c21f52393d68664fe61a8e2861f1bbe5_rle_crop_3800191673_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191678_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191684_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191683_0.png treat image : temp/1747347627_1458622_1358623661_0c348fc264ce13446fcd2a0fb1875d01_rle_crop_3800191681_0.png treat image : temp/1747347627_1458622_1358627677_35c3b6d3694d6d7865b70f9040fbd15d_rle_crop_3800191542_0.png treat image : temp/1747347627_1458622_1358624618_c6ac2e0b450da278a920a83affcfad4d_rle_crop_3800191580_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 175 time used for this insertion : 0.025432109832763672 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 175 time used for this insertion : 0.040960073471069336 save missing photos in datou_result : time spend for datou_step_exec : 10.51908802986145 time spend to save output : 0.0829322338104248 total time spend for step 7 : 10.602020263671875 step8:velours_tree Fri May 16 00:27:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.18540191650390625 time spend to save output : 3.528594970703125e-05 total time spend for step 8 : 0.18543720245361328 step9:send_mail_cod Fri May 16 00:27:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23035151_16-05-2025_00_27_49.pdf 23035847 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230358471747348069 23035848 imagette230358481747348071 23035849 change filename to text .imagette230358491747348071 23035850 imagette230358501747348071 23035852 imagette230358521747348071 23035853 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230358531747348071 23035854 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette230358541747348072 23035855 imagette230358551747348073 23035856 imagette230358561747348074 23035857 change filename to text .imagette230358571747348074 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23035151 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23035847,23035848,23035849,23035850,23035851,23035852,23035853,23035854,23035855,23035856,23035857?tags=pet_clair,metal,autre,pet_fonce,environnement,background,papier,carton,flou,mal_croppe,pehd args[1358627706] : ((1358627706, 0.8088699324232258, 492688767), (1358627706, 0.19820548598623744, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358627677] : ((1358627677, 0.7423897995245935, 492688767), (1358627677, 0.21095514597899678, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358627646] : ((1358627646, -1.2336401647126656, 492688767), (1358627646, 0.40627224940786333, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358626081] : ((1358626081, -0.24869113135955861, 492688767), (1358626081, 0.22525546807607574, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358624618] : ((1358624618, -1.6954472434856207, 492688767), (1358624618, 0.08986718961774057, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358624552] : ((1358624552, 1.3147092104406903, 492688767), (1358624552, 0.19163494550582721, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358624490] : ((1358624490, -3.293269568595424, 492609224), (1358624490, -0.044198365253862365, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358624420] : ((1358624420, 0.06328245671795285, 492688767), (1358624420, -0.13776168616989268, 496442774), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358623771] : ((1358623771, -0.5426721888227046, 492688767), (1358623771, 0.40422368109582896, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358623712] : ((1358623712, -3.4174572669085035, 492609224), (1358623712, 0.0703535229752734, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com args[1358623661] : ((1358623661, -1.4374361439703753, 492688767), (1358623661, 0.3518230761418606, 2107752395), '0.13383793253201948') We are sending mail with results at report@fotonower.com refus_total : 0.13383793253201948 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23035151 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23035151_16-05-2025_00_27_49.pdf results_Auto_P23035151_16-05-2025_00_27_49.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23035151_16-05-2025_00_27_49.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23035151','results_Auto_P23035151_16-05-2025_00_27_49.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23035151_16-05-2025_00_27_49.pdf','pdf','','0.66','0.13383793253201948') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23035151

https://www.fotonower.com/image?json=false&list_photos_id=1358627706
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358627677
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358627646
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358626081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358624618
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358624552
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3147092104406903)
https://www.fotonower.com/image?json=false&list_photos_id=1358624490
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358624420
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358623771
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358623712
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358623661
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.38%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/23035847?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23035849?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23035853?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23035854?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/23035857?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23035151_16-05-2025_00_27_49.pdf.

Lien vers velours :https://www.fotonower.com/velours/23035847,23035848,23035849,23035850,23035851,23035852,23035853,23035854,23035855,23035856,23035857?tags=pet_clair,metal,autre,pet_fonce,environnement,background,papier,carton,flou,mal_croppe,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 15 May 2025 22:27:56 GMT Content-Length: 0 Connection: close X-Message-Id: PFcO3h1YT4GYP3qf2Ea1Wg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358627706, 1358627677, 1358627646, 1358626081, 1358624618, 1358624552, 1358624490, 1358624420, 1358623771, 1358623712, 1358623661] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627706', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627677', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627646', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358626081', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624618', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624552', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624490', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624420', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623771', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623712', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623661', None, None, None, None, None, '2869886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016049623489379883 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.546976327896118 time spend to save output : 0.016330957412719727 total time spend for step 9 : 7.563307285308838 step10:split_time_score Fri May 16 00:27:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15052025 23035151 Nombre de photos uploadées : 11 / 23040 (0%) 15052025 23035151 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 15052025 23035151 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005521774291992188 elapsed_time : insert_dashboard_record_day_entry 0.027189970016479492 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09941705530591866 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23021836_15-05-2025_20_05_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23021836 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23021836 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23021844 order by id desc limit 1 Qualite : 0.11656135755017494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23021849_15-05-2025_20_03_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23021849 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23021849 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035123 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035126 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035128 order by id desc limit 1 Qualite : 0.12704887993005845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23021871_15-05-2025_19_30_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23021871 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23021871 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23021873 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035138 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035140 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035145 order by id desc limit 1 Qualite : 0.13383793253201948 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23035151_16-05-2025_00_27_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23035151 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23035151 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358627706, 1358627677, 1358627646, 1358626081, 1358624618, 1358624552, 1358624490, 1358624420, 1358623771, 1358623712, 1358623661] Looping around the photos to save general results len do output : 1 /23035151Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627706', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627677', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358627646', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358626081', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624618', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624552', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624490', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358624420', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623771', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623712', None, None, None, None, None, '2869886') ('3318', None, None, None, None, None, None, None, '2869886') ('3318', '23035151', '1358623661', None, None, None, None, None, '2869886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013149261474609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.595989465713501 time spend to save output : 0.013385295867919922 total time spend for step 10 : 7.609374761581421 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 162.75user 216.37system 7:40.25elapsed 82%CPU (0avgtext+0avgdata 5528588maxresident)k 574960inputs+98616outputs (273major+15124257minor)pagefaults 0swaps