python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2695636 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2589649'] with mtr_portfolio_ids : ['20577695'] and first list_photo_ids : [] new path : /proc/2695636/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.7401070594787598 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Feb 14 23:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-14 23:10:34.586798: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-14 23:10:34.615282: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-14 23:10:34.617119: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc10c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-14 23:10:34.617152: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-14 23:10:34.620451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-14 23:10:34.758570: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb4f59b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-14 23:10:34.758630: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-14 23:10:34.760066: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 23:10:34.760526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 23:10:34.763491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 23:10:34.765990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 23:10:34.766380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 23:10:34.768929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 23:10:34.770182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 23:10:34.775280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 23:10:34.776953: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 23:10:34.777036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 23:10:34.777762: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 23:10:34.777778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 23:10:34.777787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 23:10:34.779050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9298 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-14 23:10:35.035026: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 23:10:35.035124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 23:10:35.035153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 23:10:35.035178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 23:10:35.035202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 23:10:35.035226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 23:10:35.035251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 23:10:35.035275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 23:10:35.036738: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 23:10:35.037858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 23:10:35.037911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 23:10:35.037930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 23:10:35.037946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 23:10:35.037962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 23:10:35.037978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 23:10:35.037994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 23:10:35.038009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 23:10:35.039272: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 23:10:35.039304: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 23:10:35.039312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 23:10:35.039320: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 23:10:35.040612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9298 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-14 23:10:46.820702: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 23:10:47.090776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 23:10:48.041558: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:48.043859: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:49.701385: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:49.703350: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:51.420894: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:51.422768: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:52.747178: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:52.749131: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:54.976441: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-02-14 23:10:54.978934: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1739571030_2695636_1337707837_bc47acb7d886ed0610beb2be8b50404f.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_1/_54]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1739571030_2695636_1337707835_98094e5af7829c39002ff4ebe3ee2eaf.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_1/_54]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1739571030_2695636_1337707833_1aa877f6f9e74f6a2fda30e6fed22e93.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_1/_54]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1739571030_2695636_1337707805_0aab28daea2f657f9b21d7ac9ba0ff5c.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_1/_54]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1739571030_2695636_1337704104_442b971c9ffe82a6a529c38d4553be74.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[mrcnn_detection/ExpandDims_1/_54]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 Detection mask done ! Trying to reset tf kernel 2696439 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5462 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007185935974121094 nb_pixel_total : 10389 time to create 1 rle with old method : 0.011206388473510742 length of segment : 139 time for calcul the mask position with numpy : 0.0015773773193359375 nb_pixel_total : 41194 time to create 1 rle with old method : 0.04680347442626953 length of segment : 193 time for calcul the mask position with numpy : 0.004278898239135742 nb_pixel_total : 109050 time to create 1 rle with old method : 0.11583995819091797 length of segment : 363 time for calcul the mask position with numpy : 0.0037353038787841797 nb_pixel_total : 94169 time to create 1 rle with old method : 0.10335206985473633 length of segment : 409 time for calcul the mask position with numpy : 0.0048465728759765625 nb_pixel_total : 122944 time to create 1 rle with old method : 0.13552188873291016 length of segment : 419 time for calcul the mask position with numpy : 0.0005972385406494141 nb_pixel_total : 21331 time to create 1 rle with old method : 0.024022817611694336 length of segment : 189 time for calcul the mask position with numpy : 0.001520395278930664 nb_pixel_total : 44499 time to create 1 rle with old method : 0.04641246795654297 length of segment : 325 time for calcul the mask position with numpy : 0.003734588623046875 nb_pixel_total : 120651 time to create 1 rle with old method : 0.13349056243896484 length of segment : 422 time for calcul the mask position with numpy : 0.00102996826171875 nb_pixel_total : 25482 time to create 1 rle with old method : 0.027843475341796875 length of segment : 223 time for calcul the mask position with numpy : 0.004177570343017578 nb_pixel_total : 135942 time to create 1 rle with old method : 0.1463150978088379 length of segment : 724 time for calcul the mask position with numpy : 0.0016367435455322266 nb_pixel_total : 45451 time to create 1 rle with old method : 0.05032968521118164 length of segment : 335 time for calcul the mask position with numpy : 0.0004985332489013672 nb_pixel_total : 14310 time to create 1 rle with old method : 0.015925168991088867 length of segment : 140 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 8329 time to create 1 rle with old method : 0.009289979934692383 length of segment : 136 time for calcul the mask position with numpy : 0.0021686553955078125 nb_pixel_total : 83825 time to create 1 rle with old method : 0.08980631828308105 length of segment : 414 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 20862 time to create 1 rle with old method : 0.023182392120361328 length of segment : 194 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 4836 time to create 1 rle with old method : 0.005547761917114258 length of segment : 76 time for calcul the mask position with numpy : 0.005040645599365234 nb_pixel_total : 221549 time to create 1 rle with new method : 0.013727903366088867 length of segment : 460 time for calcul the mask position with numpy : 0.00025010108947753906 nb_pixel_total : 13011 time to create 1 rle with old method : 0.013825654983520508 length of segment : 118 time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 19695 time to create 1 rle with old method : 0.020725727081298828 length of segment : 238 time for calcul the mask position with numpy : 0.0012354850769042969 nb_pixel_total : 53138 time to create 1 rle with old method : 0.056713104248046875 length of segment : 362 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 21994 time to create 1 rle with old method : 0.02238774299621582 length of segment : 224 time for calcul the mask position with numpy : 0.0008606910705566406 nb_pixel_total : 37812 time to create 1 rle with old method : 0.03885674476623535 length of segment : 351 time for calcul the mask position with numpy : 0.0004787445068359375 nb_pixel_total : 28364 time to create 1 rle with old method : 0.032708168029785156 length of segment : 203 time for calcul the mask position with numpy : 0.0004851818084716797 nb_pixel_total : 29453 time to create 1 rle with old method : 0.0326695442199707 length of segment : 206 time for calcul the mask position with numpy : 0.002763509750366211 nb_pixel_total : 185842 time to create 1 rle with new method : 0.010837316513061523 length of segment : 527 time for calcul the mask position with numpy : 0.0006699562072753906 nb_pixel_total : 39142 time to create 1 rle with old method : 0.04432940483093262 length of segment : 331 time for calcul the mask position with numpy : 0.0006623268127441406 nb_pixel_total : 39440 time to create 1 rle with old method : 0.04289555549621582 length of segment : 254 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 6788 time to create 1 rle with old method : 0.008315563201904297 length of segment : 60 time for calcul the mask position with numpy : 0.0023000240325927734 nb_pixel_total : 173080 time to create 1 rle with new method : 0.011404275894165039 length of segment : 374 time for calcul the mask position with numpy : 0.0010247230529785156 nb_pixel_total : 55995 time to create 1 rle with old method : 0.06274628639221191 length of segment : 269 time for calcul the mask position with numpy : 0.0009074211120605469 nb_pixel_total : 51918 time to create 1 rle with old method : 0.05914592742919922 length of segment : 288 time for calcul the mask position with numpy : 0.002241849899291992 nb_pixel_total : 95405 time to create 1 rle with old method : 0.10425996780395508 length of segment : 555 time for calcul the mask position with numpy : 0.0017650127410888672 nb_pixel_total : 132139 time to create 1 rle with old method : 0.1376359462738037 length of segment : 473 time for calcul the mask position with numpy : 0.002117156982421875 nb_pixel_total : 163919 time to create 1 rle with new method : 0.007929325103759766 length of segment : 416 time for calcul the mask position with numpy : 0.0018644332885742188 nb_pixel_total : 111100 time to create 1 rle with old method : 0.12003254890441895 length of segment : 539 time for calcul the mask position with numpy : 0.00023555755615234375 nb_pixel_total : 11501 time to create 1 rle with old method : 0.012471199035644531 length of segment : 114 time for calcul the mask position with numpy : 0.002305746078491211 nb_pixel_total : 154988 time to create 1 rle with new method : 0.009311914443969727 length of segment : 547 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 16213 time to create 1 rle with old method : 0.017674922943115234 length of segment : 270 time for calcul the mask position with numpy : 0.0072367191314697266 nb_pixel_total : 406186 time to create 1 rle with new method : 1.2260918617248535 length of segment : 1872 time for calcul the mask position with numpy : 0.0011827945709228516 nb_pixel_total : 42777 time to create 1 rle with old method : 0.04536771774291992 length of segment : 233 time for calcul the mask position with numpy : 0.0013654232025146484 nb_pixel_total : 40256 time to create 1 rle with old method : 0.04618263244628906 length of segment : 244 time for calcul the mask position with numpy : 0.0012676715850830078 nb_pixel_total : 83402 time to create 1 rle with old method : 0.08407235145568848 length of segment : 541 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 10488 time to create 1 rle with old method : 0.011544466018676758 length of segment : 122 time for calcul the mask position with numpy : 0.0011889934539794922 nb_pixel_total : 42411 time to create 1 rle with old method : 0.045572757720947266 length of segment : 271 time for calcul the mask position with numpy : 0.0036275386810302734 nb_pixel_total : 84095 time to create 1 rle with old method : 0.08630657196044922 length of segment : 363 time for calcul the mask position with numpy : 0.00889444351196289 nb_pixel_total : 258467 time to create 1 rle with new method : 0.02516770362854004 length of segment : 930 time for calcul the mask position with numpy : 0.001386880874633789 nb_pixel_total : 88522 time to create 1 rle with old method : 0.09392833709716797 length of segment : 361 time for calcul the mask position with numpy : 0.004426717758178711 nb_pixel_total : 133387 time to create 1 rle with old method : 0.14027667045593262 length of segment : 463 time for calcul the mask position with numpy : 0.0012497901916503906 nb_pixel_total : 28765 time to create 1 rle with old method : 0.03148293495178223 length of segment : 249 time for calcul the mask position with numpy : 0.0015773773193359375 nb_pixel_total : 42587 time to create 1 rle with old method : 0.044619083404541016 length of segment : 270 time for calcul the mask position with numpy : 0.005340099334716797 nb_pixel_total : 138983 time to create 1 rle with old method : 0.14376425743103027 length of segment : 473 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 10310 time to create 1 rle with old method : 0.01172780990600586 length of segment : 89 time for calcul the mask position with numpy : 0.004560947418212891 nb_pixel_total : 92589 time to create 1 rle with old method : 0.09519791603088379 length of segment : 501 time for calcul the mask position with numpy : 0.0010516643524169922 nb_pixel_total : 17985 time to create 1 rle with old method : 0.01933145523071289 length of segment : 193 time for calcul the mask position with numpy : 0.0007007122039794922 nb_pixel_total : 17932 time to create 1 rle with old method : 0.018869876861572266 length of segment : 162 time for calcul the mask position with numpy : 0.0015959739685058594 nb_pixel_total : 41811 time to create 1 rle with old method : 0.042389869689941406 length of segment : 349 time for calcul the mask position with numpy : 0.0014688968658447266 nb_pixel_total : 33805 time to create 1 rle with old method : 0.040079593658447266 length of segment : 268 time for calcul the mask position with numpy : 0.002025127410888672 nb_pixel_total : 48613 time to create 1 rle with old method : 0.05146074295043945 length of segment : 252 time for calcul the mask position with numpy : 0.0009751319885253906 nb_pixel_total : 16582 time to create 1 rle with old method : 0.018238306045532227 length of segment : 181 time for calcul the mask position with numpy : 0.006534099578857422 nb_pixel_total : 158403 time to create 1 rle with new method : 0.011194229125976562 length of segment : 629 time for calcul the mask position with numpy : 0.0006096363067626953 nb_pixel_total : 11025 time to create 1 rle with old method : 0.012508869171142578 length of segment : 114 time for calcul the mask position with numpy : 0.0008764266967773438 nb_pixel_total : 21458 time to create 1 rle with old method : 0.024401187896728516 length of segment : 160 time for calcul the mask position with numpy : 0.004441738128662109 nb_pixel_total : 96203 time to create 1 rle with old method : 0.09678483009338379 length of segment : 482 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 11728 time to create 1 rle with old method : 0.013769865036010742 length of segment : 150 time for calcul the mask position with numpy : 0.00894618034362793 nb_pixel_total : 269301 time to create 1 rle with new method : 0.02051258087158203 length of segment : 571 time for calcul the mask position with numpy : 0.001332998275756836 nb_pixel_total : 51245 time to create 1 rle with old method : 0.051650047302246094 length of segment : 213 time for calcul the mask position with numpy : 0.002836465835571289 nb_pixel_total : 58397 time to create 1 rle with old method : 0.05932426452636719 length of segment : 373 time for calcul the mask position with numpy : 0.00515437126159668 nb_pixel_total : 178953 time to create 1 rle with new method : 0.00820469856262207 length of segment : 461 time for calcul the mask position with numpy : 0.0036318302154541016 nb_pixel_total : 98954 time to create 1 rle with old method : 0.11104035377502441 length of segment : 240 time for calcul the mask position with numpy : 0.003149747848510742 nb_pixel_total : 55517 time to create 1 rle with old method : 0.06310415267944336 length of segment : 305 time for calcul the mask position with numpy : 0.003960847854614258 nb_pixel_total : 110049 time to create 1 rle with old method : 0.1152186393737793 length of segment : 399 time for calcul the mask position with numpy : 0.0009260177612304688 nb_pixel_total : 15900 time to create 1 rle with old method : 0.01818084716796875 length of segment : 166 time for calcul the mask position with numpy : 0.00047588348388671875 nb_pixel_total : 20698 time to create 1 rle with old method : 0.023782968521118164 length of segment : 285 time for calcul the mask position with numpy : 0.0008337497711181641 nb_pixel_total : 12969 time to create 1 rle with old method : 0.014282464981079102 length of segment : 142 time for calcul the mask position with numpy : 0.0037543773651123047 nb_pixel_total : 91631 time to create 1 rle with old method : 0.10144805908203125 length of segment : 385 time for calcul the mask position with numpy : 0.0022957324981689453 nb_pixel_total : 40635 time to create 1 rle with old method : 0.04246664047241211 length of segment : 321 time for calcul the mask position with numpy : 0.001749277114868164 nb_pixel_total : 31740 time to create 1 rle with old method : 0.036539316177368164 length of segment : 284 time for calcul the mask position with numpy : 0.004023075103759766 nb_pixel_total : 82332 time to create 1 rle with old method : 0.08752679824829102 length of segment : 554 time for calcul the mask position with numpy : 0.011351585388183594 nb_pixel_total : 331214 time to create 1 rle with new method : 0.017787694931030273 length of segment : 691 time for calcul the mask position with numpy : 0.0009531974792480469 nb_pixel_total : 16184 time to create 1 rle with old method : 0.01912403106689453 length of segment : 125 time for calcul the mask position with numpy : 0.0006413459777832031 nb_pixel_total : 15346 time to create 1 rle with old method : 0.01874828338623047 length of segment : 111 time for calcul the mask position with numpy : 0.0010371208190917969 nb_pixel_total : 23882 time to create 1 rle with old method : 0.025516033172607422 length of segment : 189 time for calcul the mask position with numpy : 0.0025336742401123047 nb_pixel_total : 80218 time to create 1 rle with old method : 0.08474564552307129 length of segment : 353 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 3277 time to create 1 rle with old method : 0.003958940505981445 length of segment : 55 time for calcul the mask position with numpy : 0.0005178451538085938 nb_pixel_total : 14695 time to create 1 rle with old method : 0.016879796981811523 length of segment : 126 time for calcul the mask position with numpy : 0.0029599666595458984 nb_pixel_total : 55263 time to create 1 rle with old method : 0.06168079376220703 length of segment : 387 time for calcul the mask position with numpy : 0.0019335746765136719 nb_pixel_total : 37626 time to create 1 rle with old method : 0.042009830474853516 length of segment : 390 time for calcul the mask position with numpy : 0.0008285045623779297 nb_pixel_total : 23053 time to create 1 rle with old method : 0.024882078170776367 length of segment : 139 time for calcul the mask position with numpy : 0.0005173683166503906 nb_pixel_total : 18673 time to create 1 rle with old method : 0.02083134651184082 length of segment : 173 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 5794 time to create 1 rle with old method : 0.006474733352661133 length of segment : 100 time for calcul the mask position with numpy : 0.002511262893676758 nb_pixel_total : 66685 time to create 1 rle with old method : 0.07426905632019043 length of segment : 314 time for calcul the mask position with numpy : 0.007429838180541992 nb_pixel_total : 199290 time to create 1 rle with new method : 0.011464357376098633 length of segment : 457 time for calcul the mask position with numpy : 0.0057909488677978516 nb_pixel_total : 174074 time to create 1 rle with new method : 0.009306192398071289 length of segment : 780 time for calcul the mask position with numpy : 0.0019578933715820312 nb_pixel_total : 35193 time to create 1 rle with old method : 0.03740811347961426 length of segment : 531 time for calcul the mask position with numpy : 0.0016307830810546875 nb_pixel_total : 44510 time to create 1 rle with old method : 0.047715187072753906 length of segment : 270 time for calcul the mask position with numpy : 0.0014524459838867188 nb_pixel_total : 20003 time to create 1 rle with old method : 0.022095441818237305 length of segment : 288 time for calcul the mask position with numpy : 0.0006415843963623047 nb_pixel_total : 12357 time to create 1 rle with old method : 0.013902902603149414 length of segment : 153 time for calcul the mask position with numpy : 0.0029540061950683594 nb_pixel_total : 85924 time to create 1 rle with old method : 0.09066104888916016 length of segment : 358 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 8843 time to create 1 rle with old method : 0.009976863861083984 length of segment : 155 time for calcul the mask position with numpy : 0.0030927658081054688 nb_pixel_total : 85773 time to create 1 rle with old method : 0.08915019035339355 length of segment : 806 time for calcul the mask position with numpy : 0.0064961910247802734 nb_pixel_total : 217320 time to create 1 rle with new method : 0.009865045547485352 length of segment : 726 time for calcul the mask position with numpy : 0.0022912025451660156 nb_pixel_total : 55022 time to create 1 rle with old method : 0.06064248085021973 length of segment : 192 time for calcul the mask position with numpy : 0.0004298686981201172 nb_pixel_total : 8421 time to create 1 rle with old method : 0.01017904281616211 length of segment : 69 time for calcul the mask position with numpy : 0.0009355545043945312 nb_pixel_total : 27555 time to create 1 rle with old method : 0.0301971435546875 length of segment : 209 time for calcul the mask position with numpy : 0.0013210773468017578 nb_pixel_total : 18516 time to create 1 rle with old method : 0.019804716110229492 length of segment : 227 time for calcul the mask position with numpy : 0.0026590824127197266 nb_pixel_total : 77838 time to create 1 rle with old method : 0.08672118186950684 length of segment : 477 time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 9940 time to create 1 rle with old method : 0.01233220100402832 length of segment : 95 time for calcul the mask position with numpy : 0.0005509853363037109 nb_pixel_total : 9396 time to create 1 rle with old method : 0.011121034622192383 length of segment : 176 time for calcul the mask position with numpy : 0.0003974437713623047 nb_pixel_total : 10959 time to create 1 rle with old method : 0.012177705764770508 length of segment : 247 time for calcul the mask position with numpy : 0.0006046295166015625 nb_pixel_total : 13421 time to create 1 rle with old method : 0.015257120132446289 length of segment : 128 time for calcul the mask position with numpy : 0.0030374526977539062 nb_pixel_total : 122331 time to create 1 rle with old method : 0.12732172012329102 length of segment : 545 time for calcul the mask position with numpy : 0.004607439041137695 nb_pixel_total : 138192 time to create 1 rle with old method : 0.14122867584228516 length of segment : 447 time for calcul the mask position with numpy : 0.0006296634674072266 nb_pixel_total : 12510 time to create 1 rle with old method : 0.01360321044921875 length of segment : 149 time for calcul the mask position with numpy : 0.0006589889526367188 nb_pixel_total : 10890 time to create 1 rle with old method : 0.01147317886352539 length of segment : 160 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 2966 time to create 1 rle with old method : 0.0034019947052001953 length of segment : 91 time for calcul the mask position with numpy : 0.002619028091430664 nb_pixel_total : 95603 time to create 1 rle with old method : 0.09978055953979492 length of segment : 341 time for calcul the mask position with numpy : 0.0005435943603515625 nb_pixel_total : 18210 time to create 1 rle with old method : 0.020420551300048828 length of segment : 95 time for calcul the mask position with numpy : 0.0012722015380859375 nb_pixel_total : 48647 time to create 1 rle with old method : 0.05247855186462402 length of segment : 193 time for calcul the mask position with numpy : 0.0006761550903320312 nb_pixel_total : 36606 time to create 1 rle with old method : 0.04088950157165527 length of segment : 177 time for calcul the mask position with numpy : 0.0008959770202636719 nb_pixel_total : 6955 time to create 1 rle with old method : 0.009507417678833008 length of segment : 156 time for calcul the mask position with numpy : 0.0008113384246826172 nb_pixel_total : 30959 time to create 1 rle with old method : 0.03530693054199219 length of segment : 163 time spent for convertir_results : 12.89402151107788 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 121 chid ids of type : 3594 Number RLEs to save : 38515 save missing photos in datou_result : time spend for datou_step_exec : 77.78261590003967 time spend to save output : 2.476465940475464 total time spend for step 1 : 80.25908184051514 step2:crop_condition Fri Feb 14 23:11:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 73 About to insert : list_path_to_insert length 73 new photo from crops ! About to upload 73 photos upload in portfolio : 3736932 init cache_photo without model_param we have 73 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571132_2695636 we have uploaded 73 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.179742336273193 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571156_2695636 we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.319514513015747 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571162_2695636 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9082744121551514 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571176_2695636 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.630402326583862 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571183_2695636 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6637997627258301 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571186_2695636 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5926103591918945 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739571189_2695636 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6343886852264404 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337707837, 1337707835, 1337707833, 1337707805, 1337704104, 1337704092, 1337704090, 1337704084, 1337703923, 1337703917, 1337703873] Looping around the photos to save general results len do output : 121 /1337736854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337736996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337737018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707837', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707835', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707833', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707805', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704104', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704092', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704090', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704084', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703923', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703917', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703873', None, None, None, None, None, '2589649') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 374 time used for this insertion : 0.029865503311157227 save_final save missing photos in datou_result : time spend for datou_step_exec : 77.39685606956482 time spend to save output : 0.03434944152832031 total time spend for step 2 : 77.43120551109314 step3:rle_unique_nms_with_priority Fri Feb 14 23:13:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 121 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1337707837 No data in photo_id : 1337707835 No data in photo_id : 1337707833 No data in photo_id : 1337707805 No data in photo_id : 1337704104 nb_obj : 15 nb_hashtags : 5 time to prepare the origin masks : 5.146348237991333 time for calcul the mask position with numpy : 0.5604825019836426 nb_pixel_total : 6171303 time to create 1 rle with new method : 0.8139278888702393 time for calcul the mask position with numpy : 0.02120232582092285 nb_pixel_total : 1374 time to create 1 rle with old method : 0.0015835762023925781 time for calcul the mask position with numpy : 0.020148038864135742 nb_pixel_total : 83825 time to create 1 rle with old method : 0.0845634937286377 time for calcul the mask position with numpy : 0.02049565315246582 nb_pixel_total : 8326 time to create 1 rle with old method : 0.009413719177246094 time for calcul the mask position with numpy : 0.021329879760742188 nb_pixel_total : 14310 time to create 1 rle with old method : 0.015755891799926758 time for calcul the mask position with numpy : 0.022036075592041016 nb_pixel_total : 45451 time to create 1 rle with old method : 0.05340719223022461 time for calcul the mask position with numpy : 0.022437572479248047 nb_pixel_total : 135942 time to create 1 rle with old method : 0.14832186698913574 time for calcul the mask position with numpy : 0.023717641830444336 nb_pixel_total : 25482 time to create 1 rle with old method : 0.030408143997192383 time for calcul the mask position with numpy : 0.02470993995666504 nb_pixel_total : 120651 time to create 1 rle with old method : 0.13536381721496582 time for calcul the mask position with numpy : 0.022105693817138672 nb_pixel_total : 44499 time to create 1 rle with old method : 0.050016164779663086 time for calcul the mask position with numpy : 0.021846532821655273 nb_pixel_total : 21331 time to create 1 rle with old method : 0.02431511878967285 time for calcul the mask position with numpy : 0.022233009338378906 nb_pixel_total : 122944 time to create 1 rle with old method : 0.1313033103942871 time for calcul the mask position with numpy : 0.021854162216186523 nb_pixel_total : 94169 time to create 1 rle with old method : 0.09807682037353516 time for calcul the mask position with numpy : 0.019984722137451172 nb_pixel_total : 109050 time to create 1 rle with old method : 0.1137239933013916 time for calcul the mask position with numpy : 0.020497798919677734 nb_pixel_total : 41194 time to create 1 rle with old method : 0.04401969909667969 time for calcul the mask position with numpy : 0.021596908569335938 nb_pixel_total : 10389 time to create 1 rle with old method : 0.011356592178344727 create new chi : 2.684276819229126 time to delete rle : 0.010213613510131836 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11117 TO DO : save crop sub photo not yet done ! save time : 1.2874393463134766 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 5.38666296005249 time for calcul the mask position with numpy : 0.4550189971923828 nb_pixel_total : 5840657 time to create 1 rle with new method : 0.5939061641693115 time for calcul the mask position with numpy : 0.023174285888671875 nb_pixel_total : 132139 time to create 1 rle with old method : 0.1418895721435547 time for calcul the mask position with numpy : 0.02219533920288086 nb_pixel_total : 95405 time to create 1 rle with old method : 0.1124415397644043 time for calcul the mask position with numpy : 0.021640777587890625 nb_pixel_total : 51918 time to create 1 rle with old method : 0.05446028709411621 time for calcul the mask position with numpy : 0.021493196487426758 nb_pixel_total : 55995 time to create 1 rle with old method : 0.060585737228393555 time for calcul the mask position with numpy : 0.0264739990234375 nb_pixel_total : 173080 time to create 1 rle with new method : 0.6042423248291016 time for calcul the mask position with numpy : 0.020343542098999023 nb_pixel_total : 6788 time to create 1 rle with old method : 0.007158756256103516 time for calcul the mask position with numpy : 0.020491838455200195 nb_pixel_total : 39440 time to create 1 rle with old method : 0.03926348686218262 time for calcul the mask position with numpy : 0.019995689392089844 nb_pixel_total : 39142 time to create 1 rle with old method : 0.051224470138549805 time for calcul the mask position with numpy : 0.021845579147338867 nb_pixel_total : 185842 time to create 1 rle with new method : 0.5990948677062988 time for calcul the mask position with numpy : 0.02131032943725586 nb_pixel_total : 29453 time to create 1 rle with old method : 0.030128955841064453 time for calcul the mask position with numpy : 0.0212094783782959 nb_pixel_total : 28364 time to create 1 rle with old method : 0.02938389778137207 time for calcul the mask position with numpy : 0.020219087600708008 nb_pixel_total : 37812 time to create 1 rle with old method : 0.03800487518310547 time for calcul the mask position with numpy : 0.019163846969604492 nb_pixel_total : 21994 time to create 1 rle with old method : 0.0222012996673584 time for calcul the mask position with numpy : 0.01931452751159668 nb_pixel_total : 53138 time to create 1 rle with old method : 0.0527491569519043 time for calcul the mask position with numpy : 0.020481586456298828 nb_pixel_total : 19677 time to create 1 rle with old method : 0.020954370498657227 time for calcul the mask position with numpy : 0.021352052688598633 nb_pixel_total : 13011 time to create 1 rle with old method : 0.013567209243774414 time for calcul the mask position with numpy : 0.021158933639526367 nb_pixel_total : 221549 time to create 1 rle with new method : 0.5821733474731445 time for calcul the mask position with numpy : 0.021977663040161133 nb_pixel_total : 4836 time to create 1 rle with old method : 0.005753993988037109 create new chi : 4.002105474472046 time to delete rle : 0.002115488052368164 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 12890 TO DO : save crop sub photo not yet done ! save time : 1.485351800918579 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.081014633178711 time for calcul the mask position with numpy : 0.4200325012207031 nb_pixel_total : 5673508 time to create 1 rle with new method : 0.540327787399292 time for calcul the mask position with numpy : 0.02008509635925293 nb_pixel_total : 7827 time to create 1 rle with old method : 0.008393526077270508 time for calcul the mask position with numpy : 0.020885229110717773 nb_pixel_total : 258467 time to create 1 rle with new method : 0.6159944534301758 time for calcul the mask position with numpy : 0.021605968475341797 nb_pixel_total : 84095 time to create 1 rle with old method : 0.09049224853515625 time for calcul the mask position with numpy : 0.03396892547607422 nb_pixel_total : 4246 time to create 1 rle with old method : 0.004925966262817383 time for calcul the mask position with numpy : 0.03479623794555664 nb_pixel_total : 10488 time to create 1 rle with old method : 0.011263608932495117 time for calcul the mask position with numpy : 0.033995866775512695 nb_pixel_total : 83402 time to create 1 rle with old method : 0.09235620498657227 time for calcul the mask position with numpy : 0.033521175384521484 nb_pixel_total : 40256 time to create 1 rle with old method : 0.042994022369384766 time for calcul the mask position with numpy : 0.0327606201171875 nb_pixel_total : 28605 time to create 1 rle with old method : 0.029708385467529297 time for calcul the mask position with numpy : 0.03598141670227051 nb_pixel_total : 406186 time to create 1 rle with new method : 0.4676034450531006 time for calcul the mask position with numpy : 0.033940792083740234 nb_pixel_total : 11652 time to create 1 rle with old method : 0.01609659194946289 time for calcul the mask position with numpy : 0.034165143966674805 nb_pixel_total : 154988 time to create 1 rle with new method : 0.9952337741851807 time for calcul the mask position with numpy : 0.03302168846130371 nb_pixel_total : 11501 time to create 1 rle with old method : 0.011407136917114258 time for calcul the mask position with numpy : 0.03212618827819824 nb_pixel_total : 111100 time to create 1 rle with old method : 0.10599470138549805 time for calcul the mask position with numpy : 0.0328671932220459 nb_pixel_total : 163919 time to create 1 rle with new method : 0.5164625644683838 create new chi : 4.523377895355225 time to delete rle : 0.003288745880126953 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 15201 TO DO : save crop sub photo not yet done ! save time : 1.100126028060913 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 6.792032480239868 time for calcul the mask position with numpy : 0.3367342948913574 nb_pixel_total : 5471261 time to create 1 rle with new method : 0.758537769317627 time for calcul the mask position with numpy : 0.0245058536529541 nb_pixel_total : 98954 time to create 1 rle with old method : 0.11176419258117676 time for calcul the mask position with numpy : 0.02366185188293457 nb_pixel_total : 178953 time to create 1 rle with new method : 0.5205168724060059 time for calcul the mask position with numpy : 0.021358966827392578 nb_pixel_total : 58397 time to create 1 rle with old method : 0.061276912689208984 time for calcul the mask position with numpy : 0.021031856536865234 nb_pixel_total : 51245 time to create 1 rle with old method : 0.05306243896484375 time for calcul the mask position with numpy : 0.021913528442382812 nb_pixel_total : 269301 time to create 1 rle with new method : 0.6472742557525635 time for calcul the mask position with numpy : 0.02070927619934082 nb_pixel_total : 11691 time to create 1 rle with old method : 0.012447834014892578 time for calcul the mask position with numpy : 0.020142793655395508 nb_pixel_total : 96203 time to create 1 rle with old method : 0.09881854057312012 time for calcul the mask position with numpy : 0.020262479782104492 nb_pixel_total : 21458 time to create 1 rle with old method : 0.021105289459228516 time for calcul the mask position with numpy : 0.02093982696533203 nb_pixel_total : 11025 time to create 1 rle with old method : 0.011465311050415039 time for calcul the mask position with numpy : 0.02121710777282715 nb_pixel_total : 158403 time to create 1 rle with new method : 0.5129001140594482 time for calcul the mask position with numpy : 0.021932363510131836 nb_pixel_total : 16582 time to create 1 rle with old method : 0.017620563507080078 time for calcul the mask position with numpy : 0.02608656883239746 nb_pixel_total : 48613 time to create 1 rle with old method : 0.049256086349487305 time for calcul the mask position with numpy : 0.03250932693481445 nb_pixel_total : 33805 time to create 1 rle with old method : 0.03787398338317871 time for calcul the mask position with numpy : 0.03178238868713379 nb_pixel_total : 41811 time to create 1 rle with old method : 0.04254746437072754 time for calcul the mask position with numpy : 0.0315089225769043 nb_pixel_total : 17932 time to create 1 rle with old method : 0.018172740936279297 time for calcul the mask position with numpy : 0.03279829025268555 nb_pixel_total : 17985 time to create 1 rle with old method : 0.01889801025390625 time for calcul the mask position with numpy : 0.032973527908325195 nb_pixel_total : 92589 time to create 1 rle with old method : 0.09816670417785645 time for calcul the mask position with numpy : 0.03251028060913086 nb_pixel_total : 10310 time to create 1 rle with old method : 0.012074470520019531 time for calcul the mask position with numpy : 0.03151988983154297 nb_pixel_total : 138983 time to create 1 rle with old method : 0.1400446891784668 time for calcul the mask position with numpy : 0.031847238540649414 nb_pixel_total : 42587 time to create 1 rle with old method : 0.04287362098693848 time for calcul the mask position with numpy : 0.021038293838500977 nb_pixel_total : 28765 time to create 1 rle with old method : 0.02956366539001465 time for calcul the mask position with numpy : 0.023097991943359375 nb_pixel_total : 133387 time to create 1 rle with old method : 0.15689611434936523 create new chi : 4.47858190536499 time to delete rle : 0.002207517623901367 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15823 TO DO : save crop sub photo not yet done ! save time : 1.236520767211914 nb_obj : 25 nb_hashtags : 5 time to prepare the origin masks : 7.4597249031066895 time for calcul the mask position with numpy : 0.37535905838012695 nb_pixel_total : 5497660 time to create 1 rle with new method : 0.980562686920166 time for calcul the mask position with numpy : 0.020583629608154297 nb_pixel_total : 35193 time to create 1 rle with old method : 0.039890289306640625 time for calcul the mask position with numpy : 0.022691965103149414 nb_pixel_total : 174074 time to create 1 rle with new method : 0.3655552864074707 time for calcul the mask position with numpy : 0.02227640151977539 nb_pixel_total : 199290 time to create 1 rle with new method : 0.550997257232666 time for calcul the mask position with numpy : 0.02532958984375 nb_pixel_total : 66685 time to create 1 rle with old method : 0.07044172286987305 time for calcul the mask position with numpy : 0.020885944366455078 nb_pixel_total : 5794 time to create 1 rle with old method : 0.0062427520751953125 time for calcul the mask position with numpy : 0.0203249454498291 nb_pixel_total : 18673 time to create 1 rle with old method : 0.019940614700317383 time for calcul the mask position with numpy : 0.02045893669128418 nb_pixel_total : 23053 time to create 1 rle with old method : 0.02448749542236328 time for calcul the mask position with numpy : 0.020751476287841797 nb_pixel_total : 37626 time to create 1 rle with old method : 0.039730072021484375 time for calcul the mask position with numpy : 0.02536773681640625 nb_pixel_total : 55263 time to create 1 rle with old method : 0.05640769004821777 time for calcul the mask position with numpy : 0.02169632911682129 nb_pixel_total : 14695 time to create 1 rle with old method : 0.015780210494995117 time for calcul the mask position with numpy : 0.02333521842956543 nb_pixel_total : 3277 time to create 1 rle with old method : 0.003719329833984375 time for calcul the mask position with numpy : 0.02263164520263672 nb_pixel_total : 80218 time to create 1 rle with old method : 0.08476543426513672 time for calcul the mask position with numpy : 0.021244049072265625 nb_pixel_total : 23882 time to create 1 rle with old method : 0.0265047550201416 time for calcul the mask position with numpy : 0.02235102653503418 nb_pixel_total : 15346 time to create 1 rle with old method : 0.01699519157409668 time for calcul the mask position with numpy : 0.022632360458374023 nb_pixel_total : 16184 time to create 1 rle with old method : 0.01715874671936035 time for calcul the mask position with numpy : 0.023854732513427734 nb_pixel_total : 331214 time to create 1 rle with new method : 0.5791804790496826 time for calcul the mask position with numpy : 0.021942615509033203 nb_pixel_total : 82332 time to create 1 rle with old method : 0.09156298637390137 time for calcul the mask position with numpy : 0.02219104766845703 nb_pixel_total : 22382 time to create 1 rle with old method : 0.023763418197631836 time for calcul the mask position with numpy : 0.022691726684570312 nb_pixel_total : 40635 time to create 1 rle with old method : 0.04466867446899414 time for calcul the mask position with numpy : 0.021662235260009766 nb_pixel_total : 91631 time to create 1 rle with old method : 0.09894943237304688 time for calcul the mask position with numpy : 0.02675652503967285 nb_pixel_total : 12969 time to create 1 rle with old method : 0.014641761779785156 time for calcul the mask position with numpy : 0.026808977127075195 nb_pixel_total : 20698 time to create 1 rle with old method : 0.02335500717163086 time for calcul the mask position with numpy : 0.021921396255493164 nb_pixel_total : 15900 time to create 1 rle with old method : 0.017151832580566406 time for calcul the mask position with numpy : 0.022037744522094727 nb_pixel_total : 110049 time to create 1 rle with old method : 0.11462092399597168 time for calcul the mask position with numpy : 0.02345871925354004 nb_pixel_total : 55517 time to create 1 rle with old method : 0.05911874771118164 create new chi : 4.43329644203186 time to delete rle : 0.0023818016052246094 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17519 TO DO : save crop sub photo not yet done ! save time : 1.4294097423553467 nb_obj : 27 nb_hashtags : 4 time to prepare the origin masks : 3.9560821056365967 time for calcul the mask position with numpy : 0.358501672744751 nb_pixel_total : 5867167 time to create 1 rle with new method : 0.8058280944824219 time for calcul the mask position with numpy : 0.02869272232055664 nb_pixel_total : 48647 time to create 1 rle with old method : 0.051489830017089844 time for calcul the mask position with numpy : 0.028723955154418945 nb_pixel_total : 18210 time to create 1 rle with old method : 0.019023418426513672 time for calcul the mask position with numpy : 0.027582645416259766 nb_pixel_total : 234 time to create 1 rle with old method : 0.00046563148498535156 time for calcul the mask position with numpy : 0.027501821517944336 nb_pixel_total : 55022 time to create 1 rle with old method : 0.05832934379577637 time for calcul the mask position with numpy : 0.029556989669799805 nb_pixel_total : 8421 time to create 1 rle with old method : 0.009632587432861328 time for calcul the mask position with numpy : 0.029422521591186523 nb_pixel_total : 2434 time to create 1 rle with old method : 0.002918720245361328 time for calcul the mask position with numpy : 0.02913212776184082 nb_pixel_total : 10890 time to create 1 rle with old method : 0.011936426162719727 time for calcul the mask position with numpy : 0.027670621871948242 nb_pixel_total : 95603 time to create 1 rle with old method : 0.10226798057556152 time for calcul the mask position with numpy : 0.031517982482910156 nb_pixel_total : 9396 time to create 1 rle with old method : 0.01049184799194336 time for calcul the mask position with numpy : 0.028841733932495117 nb_pixel_total : 85773 time to create 1 rle with old method : 0.09661364555358887 time for calcul the mask position with numpy : 0.029048919677734375 nb_pixel_total : 2966 time to create 1 rle with old method : 0.003200531005859375 time for calcul the mask position with numpy : 0.029587984085083008 nb_pixel_total : 77838 time to create 1 rle with old method : 0.0855104923248291 time for calcul the mask position with numpy : 0.02890181541442871 nb_pixel_total : 18516 time to create 1 rle with old method : 0.019881725311279297 time for calcul the mask position with numpy : 0.028644084930419922 nb_pixel_total : 20003 time to create 1 rle with old method : 0.02143406867980957 time for calcul the mask position with numpy : 0.028952360153198242 nb_pixel_total : 10959 time to create 1 rle with old method : 0.013098955154418945 time for calcul the mask position with numpy : 0.029349088668823242 nb_pixel_total : 217320 time to create 1 rle with new method : 0.798590898513794 time for calcul the mask position with numpy : 0.0293734073638916 nb_pixel_total : 9940 time to create 1 rle with old method : 0.011440038681030273 time for calcul the mask position with numpy : 0.02950119972229004 nb_pixel_total : 138192 time to create 1 rle with old method : 0.15125131607055664 time for calcul the mask position with numpy : 0.028815507888793945 nb_pixel_total : 27555 time to create 1 rle with old method : 0.029125213623046875 time for calcul the mask position with numpy : 0.02940535545349121 nb_pixel_total : 122185 time to create 1 rle with old method : 0.12972068786621094 time for calcul the mask position with numpy : 0.02810192108154297 nb_pixel_total : 12357 time to create 1 rle with old method : 0.012706995010375977 time for calcul the mask position with numpy : 0.027443647384643555 nb_pixel_total : 30959 time to create 1 rle with old method : 0.034308433532714844 time for calcul the mask position with numpy : 0.030121326446533203 nb_pixel_total : 44510 time to create 1 rle with old method : 0.04577755928039551 time for calcul the mask position with numpy : 0.028244733810424805 nb_pixel_total : 85924 time to create 1 rle with old method : 0.08931922912597656 time for calcul the mask position with numpy : 0.028398752212524414 nb_pixel_total : 13421 time to create 1 rle with old method : 0.013687849044799805 time for calcul the mask position with numpy : 0.028328657150268555 nb_pixel_total : 8843 time to create 1 rle with old method : 0.009464740753173828 time for calcul the mask position with numpy : 0.028513431549072266 nb_pixel_total : 6955 time to create 1 rle with old method : 0.007724761962890625 create new chi : 3.84098744392395 time to delete rle : 0.0021898746490478516 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15853 TO DO : save crop sub photo not yet done ! save time : 3.831834554672241 map_output_result : {1337707837: (0.0, 'Should be the crop_list due to order', 0.0), 1337707835: (0.0, 'Should be the crop_list due to order', 0.0), 1337707833: (0.0, 'Should be the crop_list due to order', 0.0), 1337707805: (0.0, 'Should be the crop_list due to order', 0.0), 1337704104: (0.0, 'Should be the crop_list due to order', 0.0), 1337704092: (0.0, 'Should be the crop_list due to order', 0.0), 1337704090: (0.0, 'Should be the crop_list due to order', 0.0), 1337704084: (0.0, 'Should be the crop_list due to order', 0.0), 1337703923: (0.0, 'Should be the crop_list due to order', 0.0), 1337703917: (0.0, 'Should be the crop_list due to order', 0.0), 1337703873: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337707837, 1337707835, 1337707833, 1337707805, 1337704104, 1337704092, 1337704090, 1337704084, 1337703923, 1337703917, 1337703873] Looping around the photos to save general results len do output : 11 /1337707837.Didn't retrieve data . /1337707835.Didn't retrieve data . /1337707833.Didn't retrieve data . /1337707805.Didn't retrieve data . /1337704104.Didn't retrieve data . /1337704092.Didn't retrieve data . /1337704090.Didn't retrieve data . /1337704084.Didn't retrieve data . /1337703923.Didn't retrieve data . /1337703917.Didn't retrieve data . /1337703873.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707837', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707835', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707833', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707805', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704104', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704092', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704090', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704084', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703923', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703917', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703873', None, None, None, None, None, '2589649') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.012574195861816406 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.8995668888092 time spend to save output : 0.013411521911621094 total time spend for step 3 : 67.91297841072083 step4:ventilate_hashtags_in_portfolio Fri Feb 14 23:14:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20577695 get user id for portfolio 20577695 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577695 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','background','papier','pet_clair','carton','flou','autre','pet_fonce','metal','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577695 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','background','papier','pet_clair','carton','flou','autre','pet_fonce','metal','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577695 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','background','papier','pet_clair','carton','flou','autre','pet_fonce','metal','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20578050,20578051,20578052,20578053,20578054,20578055,20578056,20578057,20578058,20578059,20578060?tags=environnement,mal_croppe,background,papier,pet_clair,carton,flou,autre,pet_fonce,metal,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337707837, 1337707835, 1337707833, 1337707805, 1337704104, 1337704092, 1337704090, 1337704084, 1337703923, 1337703917, 1337703873] Looping around the photos to save general results len do output : 1 /20577695. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707837', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707835', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707833', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707805', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704104', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704092', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704090', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704084', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703923', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703917', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703873', None, None, None, None, None, '2589649') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016431808471679688 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.079257011413574 time spend to save output : 0.016706228256225586 total time spend for step 4 : 4.0959632396698 step5:final Fri Feb 14 23:14:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337707837: ('0.10031746179111374',), 1337707835: ('0.10031746179111374',), 1337707833: ('0.10031746179111374',), 1337707805: ('0.10031746179111374',), 1337704104: ('0.10031746179111374',), 1337704092: ('0.10031746179111374',), 1337704090: ('0.10031746179111374',), 1337704084: ('0.10031746179111374',), 1337703923: ('0.10031746179111374',), 1337703917: ('0.10031746179111374',), 1337703873: ('0.10031746179111374',)} new output for save of step final : {1337707837: ('0.10031746179111374',), 1337707835: ('0.10031746179111374',), 1337707833: ('0.10031746179111374',), 1337707805: ('0.10031746179111374',), 1337704104: ('0.10031746179111374',), 1337704092: ('0.10031746179111374',), 1337704090: ('0.10031746179111374',), 1337704084: ('0.10031746179111374',), 1337703923: ('0.10031746179111374',), 1337703917: ('0.10031746179111374',), 1337703873: ('0.10031746179111374',)} [1337707837, 1337707835, 1337707833, 1337707805, 1337704104, 1337704092, 1337704090, 1337704084, 1337703923, 1337703917, 1337703873] Looping around the photos to save general results len do output : 11 /1337707837.Didn't retrieve data . /1337707835.Didn't retrieve data . /1337707833.Didn't retrieve data . /1337707805.Didn't retrieve data . /1337704104.Didn't retrieve data . /1337704092.Didn't retrieve data . /1337704090.Didn't retrieve data . /1337704084.Didn't retrieve data . /1337703923.Didn't retrieve data . /1337703917.Didn't retrieve data . /1337703873.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707837', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707835', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707833', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707805', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704104', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704092', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704090', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704084', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703923', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703917', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703873', None, None, None, None, None, '2589649') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013089418411254883 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10631656646728516 time spend to save output : 0.013623714447021484 total time spend for step 5 : 0.11994028091430664 step6:blur_detection Fri Feb 14 23:14:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739571030_2695636_1337707837_bc47acb7d886ed0610beb2be8b50404f.jpg resize: (2160, 3264) 1337707837 -3.570516299640141 treat image : temp/1739571030_2695636_1337707835_98094e5af7829c39002ff4ebe3ee2eaf.jpg resize: (2160, 3264) 1337707835 -3.6351167789897074 treat image : temp/1739571030_2695636_1337707833_1aa877f6f9e74f6a2fda30e6fed22e93.jpg resize: (2160, 3264) 1337707833 -3.122437224695618 treat image : temp/1739571030_2695636_1337707805_0aab28daea2f657f9b21d7ac9ba0ff5c.jpg resize: (2160, 3264) 1337707805 -1.3240298006971485 treat image : temp/1739571030_2695636_1337704104_442b971c9ffe82a6a529c38d4553be74.jpg resize: (2160, 3264) 1337704104 -3.84730752076767 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7.jpg resize: (2160, 3264) 1337704092 -2.9078610940678504 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9.jpg resize: (2160, 3264) 1337704090 -3.8198994980149537 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95.jpg resize: (2160, 3264) 1337704084 -1.76674624149252 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8.jpg resize: (2160, 3264) 1337703923 -2.6029101124053833 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44.jpg resize: (2160, 3264) 1337703917 -3.3734218290732514 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478.jpg resize: (2160, 3264) 1337703873 -3.6685913614073944 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762365_0.png resize: (310, 185) 1337736854 -0.35848173861882904 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762368_0.png resize: (547, 427) 1337736855 -3.5463908878142365 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762366_0.png resize: (422, 436) 1337736856 -2.1774862874890073 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762373_0.png resize: (196, 175) 1337736857 -1.211084154290272 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762361_0.png resize: (363, 439) 1337736858 -2.786314550198338 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762363_0.png resize: (374, 507) 1337736859 3.6568531422418635 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762359_0.png resize: (139, 141) 1337736861 -2.0128154831452245 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762377_0.png resize: (224, 151) 1337736863 -1.756595256823533 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762385_0.png resize: (223, 266) 1337736865 -1.8263266105947962 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762390_0.png resize: (487, 316) 1337736867 -1.9122557515014698 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762376_0.png resize: (118, 149) 1337736868 -1.8157247025242917 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762382_0.png resize: (204, 229) 1337736869 -3.3177396991748953 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762381_0.png resize: (203, 204) 1337736870 -2.450117661527085 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762387_0.png resize: (364, 532) 1337736871 -4.141855264775031 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762389_0.png resize: (221, 293) 1337736872 -3.4218142081980165 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762388_0.png resize: (255, 381) 1337736873 -4.1450523165499344 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762379_0.png resize: (211, 198) 1337736874 -1.9107101809165188 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762386_0.png resize: (60, 146) 1337736875 -0.7025975211162588 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762378_0.png resize: (304, 396) 1337736877 -1.1946918460694766 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762383_0.png resize: (511, 503) 1337736878 -2.3137918598429734 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762380_0.png resize: (351, 228) 1337736879 -1.183099895762147 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762403_0.png resize: (363, 328) 1337736880 -1.5742525705606254 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762401_0.png resize: (122, 114) 1337736881 -0.8788210564846708 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762393_0.png resize: (384, 477) 1337736882 -0.7720156162977693 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762396_0.png resize: (270, 207) 1337736883 -1.4829727006897502 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762404_0.png resize: (777, 660) 1337736884 -1.0549132820191092 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762394_0.png resize: (114, 154) 1337736885 -0.3841924923039702 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762399_0.png resize: (244, 310) 1337736886 0.1447246868277215 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762426_0.png resize: (420, 567) 1337736887 -1.9367753172145945 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762406_0.png resize: (375, 552) 1337736888 -0.498926023779291 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762411_0.png resize: (497, 393) 1337736889 -0.9483495917015416 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762407_0.png resize: (249, 166) 1337736891 -1.7430585013952093 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762419_0.png resize: (103, 168) 1337736892 -0.9158822787425108 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762409_0.png resize: (463, 553) 1337736894 -1.217504678514598 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762414_0.png resize: (269, 253) 1337736895 -0.5449879130994373 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762422_0.png resize: (150, 165) 1337736896 -1.6305005924068787 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762410_0.png resize: (88, 175) 1337736897 -2.084186305286599 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762415_0.png resize: (260, 245) 1337736898 -2.633433469391602 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762427_0.png resize: (236, 582) 1337736899 -4.1639795922073715 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762424_0.png resize: (212, 321) 1337736900 -0.6744029233298584 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762425_0.png resize: (360, 349) 1337736901 -1.7940451174761727 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762408_0.png resize: (270, 254) 1337736902 -0.4558779029198365 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762417_0.png resize: (181, 127) 1337736903 -3.1863966938837067 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762439_0.png resize: (110, 192) 1337736904 -1.3695417345672878 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762445_0.png resize: (307, 256) 1337736905 -3.0025916516283373 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762432_0.png resize: (142, 133) 1337736906 -2.0475698515004783 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762435_0.png resize: (271, 327) 1337736907 -2.3620512586232345 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762431_0.png resize: (265, 120) 1337736908 -3.266376202894216 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762433_0.png resize: (333, 409) 1337736909 0.7596411973724531 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762428_0.png resize: (316, 344) 1337736910 -1.9923690213257073 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762449_0.png resize: (234, 578) 1337736911 -2.040337322869721 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762448_0.png resize: (94, 87) 1337736912 -1.2903801632331862 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762434_0.png resize: (328, 323) 1337736913 -2.4112650782375953 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762442_0.png resize: (54, 77) 1337736914 0.8161211566827771 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762436_0.png resize: (481, 354) 1337736915 -3.670116859712461 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762440_0.png resize: (186, 245) 1337736917 -1.6843016389834287 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762430_0.png resize: (166, 172) 1337736918 -0.3531906244592031 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762466_0.png resize: (110, 156) 1337736919 -2.2214501699805838 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762455_0.png resize: (151, 133) 1337736920 -1.578539445333699 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762462_0.png resize: (202, 212) 1337736921 -1.447605963525903 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762463_0.png resize: (204, 190) 1337736922 -2.2484521388316843 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762465_0.png resize: (95, 140) 1337736923 -1.8160161254073142 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762453_0.png resize: (245, 238) 1337736924 -3.8931768071329493 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762457_0.png resize: (155, 125) 1337736925 -2.6635013559387404 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762478_0.png resize: (156, 241) 1337736926 -2.766350217417052 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762458_0.png resize: (550, 252) 1337736927 -3.4939708243551015 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762473_0.png resize: (90, 49) 1337736928 -0.06463832328768382 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762477_0.png resize: (173, 375) 1337736929 -1.2787113537118293 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762454_0.png resize: (274, 202) 1337736930 -2.6158599871076094 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762470_0.png resize: (316, 629) 1337736931 -2.280300611988219 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762474_0.png resize: (304, 449) 1337736932 0.8178404275426834 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762456_0.png resize: (313, 431) 1337736933 -2.6695888188552375 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762479_0.png resize: (156, 297) 1337736934 -2.923360020607508 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762360_0.png resize: (188, 314) 1337736938 -2.778732780092962 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762374_0.png resize: (74, 100) 1337736939 -1.6535701436959434 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762375_0.png resize: (404, 891) 1337736940 -1.9928165916514025 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762405_0.png resize: (361, 380) 1337736941 -1.773028302008545 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762392_0.png resize: (416, 497) 1337736942 -3.206067663770825 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762418_0.png resize: (620, 445) 1337736943 -0.23448789806654216 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762412_0.png resize: (182, 260) 1337736944 -2.27760226987185 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762421_0.png resize: (346, 501) 1337736945 -2.11444917428537 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762447_0.png resize: (173, 173) 1337736946 -2.152049352374016 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762437_0.png resize: (647, 755) 1337736947 -0.500280789015704 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762461_0.png resize: (69, 151) 1337736948 -2.8520932516884856 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762472_0.png resize: (151, 105) 1337736949 -2.0772547327245023 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762476_0.png resize: (179, 368) 1337736950 -1.7089198132739973 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762471_0.png resize: (137, 166) 1337736951 -3.8431118673440787 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762367_0.png resize: (223, 186) 1337736956 -4.583864065949094 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762468_0.png resize: (128, 127) 1337736957 0.6604010169764065 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762475_0.png resize: (89, 261) 1337736958 -4.350089319820787 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762372_0.png resize: (403, 280) 1337736971 -2.2430911430417106 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762362_0.png resize: (405, 394) 1337736972 -4.470224378653271 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762369_0.png resize: (337, 278) 1337736973 -3.8420792566829443 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762391_0.png resize: (473, 337) 1337736974 -1.0760999963109112 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762402_0.png resize: (262, 347) 1337736975 -1.1454542489228305 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762398_0.png resize: (231, 262) 1337736976 -4.191654085588795 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762395_0.png resize: (537, 370) 1337736977 -3.6758546001052403 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762400_0.png resize: (508, 222) 1337736978 0.24341697411652216 treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762397_0.png resize: (1299, 585) 1337736979 -1.8650734930797352 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762420_0.png resize: (160, 202) 1337736980 -1.4037534709086543 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762423_0.png resize: (560, 747) 1337736981 -2.3650196801794263 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762444_0.png resize: (357, 252) 1337736982 -2.643855758913871 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762429_0.png resize: (399, 392) 1337736983 -3.3749225269558587 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762450_0.png resize: (433, 694) 1337736984 -4.197275650919953 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762441_0.png resize: (362, 340) 1337736985 -3.071267891231588 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762452_0.png resize: (251, 310) 1337736986 -3.5068482326115262 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762451_0.png resize: (744, 273) 1337736987 -3.5562064539655367 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762469_0.png resize: (537, 293) 1337736988 -3.7717356783752805 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762464_0.png resize: (477, 254) 1337736989 -4.684207626362692 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762460_0.png resize: (181, 599) 1337736990 -2.1133833798261676 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762467_0.png resize: (187, 114) 1337736991 -4.2838377124024865 treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762459_0.png resize: (718, 397) 1337736992 -4.977775468248632 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762438_0.png resize: (125, 201) 1337736996 -3.0235082135312803 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762371_0.png resize: (132, 83) 1337737011 -4.173377370958697 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762370_0.png resize: (135, 170) 1337737012 -3.8308144269279865 treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762364_0.png resize: (170, 203) 1337737013 -1.6340371126580946 treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762384_0.png resize: (323, 154) 1337737014 -1.7835962333727267 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762416_0.png resize: (249, 299) 1337737015 -1.9393024790494828 treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762413_0.png resize: (160, 159) 1337737016 -1.5569753405531739 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762443_0.png resize: (124, 167) 1337737017 -3.7667643777413518 treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762446_0.png resize: (136, 245) 1337737018 -4.627506364658757 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.02024054527282715 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.03295707702636719 save missing photos in datou_result : time spend for datou_step_exec : 37.25579237937927 time spend to save output : 0.08877205848693848 total time spend for step 6 : 37.34456443786621 step7:brightness Fri Feb 14 23:14:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739571030_2695636_1337707837_bc47acb7d886ed0610beb2be8b50404f.jpg treat image : temp/1739571030_2695636_1337707835_98094e5af7829c39002ff4ebe3ee2eaf.jpg treat image : temp/1739571030_2695636_1337707833_1aa877f6f9e74f6a2fda30e6fed22e93.jpg treat image : temp/1739571030_2695636_1337707805_0aab28daea2f657f9b21d7ac9ba0ff5c.jpg treat image : temp/1739571030_2695636_1337704104_442b971c9ffe82a6a529c38d4553be74.jpg treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7.jpg treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9.jpg treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95.jpg treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8.jpg treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44.jpg treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478.jpg treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762365_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762368_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762366_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762373_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762361_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762363_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762359_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762377_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762385_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762390_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762376_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762382_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762381_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762387_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762389_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762388_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762379_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762386_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762378_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762383_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762380_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762403_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762401_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762393_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762396_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762404_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762394_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762399_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762426_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762406_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762411_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762407_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762419_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762409_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762414_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762422_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762410_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762415_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762427_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762424_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762425_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762408_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762417_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762439_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762445_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762432_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762435_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762431_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762433_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762428_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762449_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762448_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762434_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762442_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762436_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762440_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762430_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762466_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762455_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762462_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762463_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762465_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762453_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762457_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762478_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762458_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762473_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762477_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762454_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762470_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762474_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762456_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762479_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762360_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762374_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762375_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762405_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762392_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762418_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762412_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762421_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762447_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762437_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762461_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762472_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762476_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762471_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762367_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762468_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762475_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762372_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762362_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762369_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762391_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762402_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762398_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762395_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762400_0.png treat image : temp/1739571030_2695636_1337704084_05e1e52e16ae9b3234c6045d51bc5b95_rle_crop_3675762397_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762420_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762423_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762444_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762429_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762450_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762441_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762452_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762451_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762469_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762464_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762460_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762467_0.png treat image : temp/1739571030_2695636_1337703873_2b95f85376bfc4f7c9858f4ff395e478_rle_crop_3675762459_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762438_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762371_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762370_0.png treat image : temp/1739571030_2695636_1337704092_e16e7769707af637d8f518232e668fc7_rle_crop_3675762364_0.png treat image : temp/1739571030_2695636_1337704090_24f3fa836ffed6f1f12c8a335ed5dfa9_rle_crop_3675762384_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762416_0.png treat image : temp/1739571030_2695636_1337703923_6e2c70aeb1de0730cda532d454889cb8_rle_crop_3675762413_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762443_0.png treat image : temp/1739571030_2695636_1337703917_48ef74bab74cdace09de9fd683bddc44_rle_crop_3675762446_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.023726701736450195 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.03741598129272461 save missing photos in datou_result : time spend for datou_step_exec : 10.458351135253906 time spend to save output : 0.06640267372131348 total time spend for step 7 : 10.52475380897522 step8:velours_tree Fri Feb 14 23:15:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.22507166862487793 time spend to save output : 5.793571472167969e-05 total time spend for step 8 : 0.2251296043395996 step9:send_mail_cod Fri Feb 14 23:15:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20577695_14-02-2025_23_15_09.pdf 20578051 imagette205780511739571309 20578052 imagette205780521739571309 20578053 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205780531739571309 20578054 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205780541739571311 20578055 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205780551739571313 20578056 imagette205780561739571313 20578057 change filename to text .imagette205780571739571313 20578058 change filename to text .change filename to text .imagette205780581739571314 20578059 change filename to text .change filename to text .change filename to text .imagette205780591739571314 20578060 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205780601739571314 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20577695 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20578050,20578051,20578052,20578053,20578054,20578055,20578056,20578057,20578058,20578059,20578060?tags=environnement,mal_croppe,background,papier,pet_clair,carton,flou,autre,pet_fonce,metal,pehd args[1337707837] : ((1337707837, -3.570516299640141, 492609224), (1337707837, -0.2910307401178958, 496442774), '0.10031746179111374') apple ((1337707837, -3.570516299640141, 492609224), (1337707837, -0.2910307401178958, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337707835] : ((1337707835, -3.6351167789897074, 492609224), (1337707835, -0.23053101576062318, 496442774), '0.10031746179111374') apple ((1337707835, -3.6351167789897074, 492609224), (1337707835, -0.23053101576062318, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337707833] : ((1337707833, -3.122437224695618, 492609224), (1337707833, -0.3907372827745624, 496442774), '0.10031746179111374') apple ((1337707833, -3.122437224695618, 492609224), (1337707833, -0.3907372827745624, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337707805] : ((1337707805, -1.3240298006971485, 492688767), (1337707805, -0.37267416443730056, 496442774), '0.10031746179111374') apple ((1337707805, -1.3240298006971485, 492688767), (1337707805, -0.37267416443730056, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337704104] : ((1337704104, -3.84730752076767, 492609224), (1337704104, -0.09168861286272406, 496442774), '0.10031746179111374') apple ((1337704104, -3.84730752076767, 492609224), (1337704104, -0.09168861286272406, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337704092] : ((1337704092, -2.9078610940678504, 492609224), (1337704092, -0.010990501159193358, 2107752395), '0.10031746179111374') apple ((1337704092, -2.9078610940678504, 492609224), (1337704092, -0.010990501159193358, 2107752395), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337704090] : ((1337704090, -3.8198994980149537, 492609224), (1337704090, -0.32239722338445786, 496442774), '0.10031746179111374') apple ((1337704090, -3.8198994980149537, 492609224), (1337704090, -0.32239722338445786, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337704084] : ((1337704084, -1.76674624149252, 492688767), (1337704084, -0.3062749975797167, 496442774), '0.10031746179111374') apple ((1337704084, -1.76674624149252, 492688767), (1337704084, -0.3062749975797167, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337703923] : ((1337703923, -2.6029101124053833, 492609224), (1337703923, -0.08683217996330739, 496442774), '0.10031746179111374') apple ((1337703923, -2.6029101124053833, 492609224), (1337703923, -0.08683217996330739, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337703917] : ((1337703917, -3.3734218290732514, 492609224), (1337703917, -0.3658584790051171, 496442774), '0.10031746179111374') apple ((1337703917, -3.3734218290732514, 492609224), (1337703917, -0.3658584790051171, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com args[1337703873] : ((1337703873, -3.6685913614073944, 492609224), (1337703873, -0.24277584369490723, 496442774), '0.10031746179111374') apple ((1337703873, -3.6685913614073944, 492609224), (1337703873, -0.24277584369490723, 496442774), '0.10031746179111374') We are sending mail with results at report@fotonower.com refus_total : 0.10031746179111374 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20577695 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1337703917,1337707837,1337703873,1337703923,1337704084,1337704090,1337704092,1337704104,1337707805,1337707833,1337707835) Found this number of photos: 11 begin to download photo : 1337703917 begin to download photo : 1337703923 begin to download photo : 1337704092 begin to download photo : 1337707833 download finish for photo 1337704092 begin to download photo : 1337704104 download finish for photo 1337703917 begin to download photo : 1337707837 download finish for photo 1337704104 begin to download photo : 1337707805 download finish for photo 1337703923 begin to download photo : 1337704084 download finish for photo 1337707833 begin to download photo : 1337707835 download finish for photo 1337707837 begin to download photo : 1337703873 download finish for photo 1337707805 download finish for photo 1337704084 begin to download photo : 1337704090 download finish for photo 1337703873 download finish for photo 1337707835 download finish for photo 1337704090 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577695_14-02-2025_23_15_09.pdf results_Auto_P20577695_14-02-2025_23_15_09.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577695_14-02-2025_23_15_09.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20577695','results_Auto_P20577695_14-02-2025_23_15_09.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577695_14-02-2025_23_15_09.pdf','pdf','','0.9','0.10031746179111374') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20577695

https://www.fotonower.com/image?json=false&list_photos_id=1337707837
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337707835
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337707833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337707805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337704104
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337704092
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337704090
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337704084
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337703923
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337703917
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337703873
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.03%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20578053?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20578054?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20578055?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20578057?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20578058?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20578059?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/20578060?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577695_14-02-2025_23_15_09.pdf.

Lien vers velours :https://www.fotonower.com/velours/20578050,20578051,20578052,20578053,20578054,20578055,20578056,20578057,20578058,20578059,20578060?tags=environnement,mal_croppe,background,papier,pet_clair,carton,flou,autre,pet_fonce,metal,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 14 Feb 2025 22:15:18 GMT Content-Length: 0 Connection: close X-Message-Id: 8CgMXS03SDinlY8OE3sBDw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337707837, 1337707835, 1337707833, 1337707805, 1337704104, 1337704092, 1337704090, 1337704084, 1337703923, 1337703917, 1337703873] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707837', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707835', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707833', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707805', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704104', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704092', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704090', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704084', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703923', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703917', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703873', None, None, None, None, None, '2589649') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014927387237548828 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.7173433303833 time spend to save output : 0.01516103744506836 total time spend for step 9 : 8.73250436782837 step10:split_time_score Fri Feb 14 23:15:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14022025 20577695 Nombre de photos uploadées : 11 / 23040 (0%) 14022025 20577695 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 14022025 20577695 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005247592926025391 elapsed_time : insert_dashboard_record_day_entry 0.023092031478881836 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.04584477102643678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577668_14-02-2025_23_06_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577668 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577668 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577669 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577679 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577680 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577682 order by id desc limit 1 Qualite : 0.05307959638096329 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577686_14-02-2025_23_12_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577686 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577686 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577689 order by id desc limit 1 Qualite : 0.15076601865817552 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577694_14-02-2025_23_08_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577694 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577694 AND mptpi.`type`=3594 To do Qualite : 0.10031746179111374 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20577695_14-02-2025_23_15_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577695 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577695 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14022025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337707837, 1337707835, 1337707833, 1337707805, 1337704104, 1337704092, 1337704090, 1337704084, 1337703923, 1337703917, 1337703873] Looping around the photos to save general results len do output : 1 /20577695Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707837', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707835', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707833', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337707805', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704104', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704092', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704090', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337704084', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703923', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703917', None, None, None, None, None, '2589649') ('3318', None, None, None, None, None, None, None, '2589649') ('3318', '20577695', '1337703873', None, None, None, None, None, '2589649') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.013681173324584961 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.762833595275879 time spend to save output : 0.013903617858886719 total time spend for step 10 : 5.776737213134766 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 140.11user 101.47system 4:58.48elapsed 80%CPU (0avgtext+0avgdata 5073468maxresident)k 111032inputs+128472outputs (8285major+11592557minor)pagefaults 0swaps