python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3746595 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3653356'] with mtr_portfolio_ids : ['26450291'] and first list_photo_ids : [] new path : /proc/3746595/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 23 ; length of list_pids : 23 ; length of list_args : 23 time to download the photos : 2.830646276473999 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 2 18:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10376 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-02 18:40:35.469682: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-02 18:40:35.496606: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-02 18:40:35.498731: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbe30000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-02 18:40:35.498780: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-02 18:40:35.502516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-02 18:40:35.647142: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xf68b020 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-02 18:40:35.647208: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-02 18:40:35.648538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-02 18:40:35.649085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 18:40:35.652662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 18:40:35.655932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-02 18:40:35.656648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-02 18:40:35.660198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-02 18:40:35.661838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-02 18:40:35.668651: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-02 18:40:35.670672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-02 18:40:35.670818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 18:40:35.671877: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-02 18:40:35.671901: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-02 18:40:35.671915: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-02 18:40:35.673993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9467 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-02 18:40:36.044055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-02 18:40:36.044188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 18:40:36.044214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 18:40:36.044237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-02 18:40:36.044258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-02 18:40:36.044279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-02 18:40:36.044299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-02 18:40:36.044321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-02 18:40:36.045866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-02 18:40:36.047503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-02 18:40:36.047549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 18:40:36.047568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 18:40:36.047586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-02 18:40:36.047603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-02 18:40:36.047620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-02 18:40:36.047637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-02 18:40:36.047654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-02 18:40:36.049204: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-02 18:40:36.049253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-02 18:40:36.049264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-02 18:40:36.049274: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-02 18:40:36.050702: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9467 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-02 18:40:45.699196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 18:40:45.929043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 23 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 60.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 52.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 61.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 53.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 3747527 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 14 tf kernel not reseted sub process len(results) : 23 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 23 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3284 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 9822 time to create 1 rle with old method : 0.011964797973632812 length of segment : 199 time for calcul the mask position with numpy : 0.00017952919006347656 nb_pixel_total : 9163 time to create 1 rle with old method : 0.010485649108886719 length of segment : 109 time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 12155 time to create 1 rle with old method : 0.014281272888183594 length of segment : 176 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 7825 time to create 1 rle with old method : 0.009639978408813477 length of segment : 127 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 7108 time to create 1 rle with old method : 0.008886575698852539 length of segment : 84 time for calcul the mask position with numpy : 0.0003802776336669922 nb_pixel_total : 17898 time to create 1 rle with old method : 0.02070021629333496 length of segment : 196 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 14150 time to create 1 rle with old method : 0.02176642417907715 length of segment : 145 time for calcul the mask position with numpy : 0.00027060508728027344 nb_pixel_total : 6850 time to create 1 rle with old method : 0.014133214950561523 length of segment : 73 time for calcul the mask position with numpy : 0.0004813671112060547 nb_pixel_total : 8256 time to create 1 rle with old method : 0.010736703872680664 length of segment : 221 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 7448 time to create 1 rle with old method : 0.008795499801635742 length of segment : 183 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 17090 time to create 1 rle with old method : 0.021562576293945312 length of segment : 165 time for calcul the mask position with numpy : 0.00015020370483398438 nb_pixel_total : 5868 time to create 1 rle with old method : 0.006905555725097656 length of segment : 142 time for calcul the mask position with numpy : 0.0002079010009765625 nb_pixel_total : 4371 time to create 1 rle with old method : 0.0051555633544921875 length of segment : 166 time for calcul the mask position with numpy : 0.0029687881469726562 nb_pixel_total : 96569 time to create 1 rle with old method : 0.10920858383178711 length of segment : 554 time for calcul the mask position with numpy : 0.0016222000122070312 nb_pixel_total : 62901 time to create 1 rle with old method : 0.07348132133483887 length of segment : 343 time for calcul the mask position with numpy : 0.0001323223114013672 nb_pixel_total : 4529 time to create 1 rle with old method : 0.0055811405181884766 length of segment : 102 time for calcul the mask position with numpy : 0.00044536590576171875 nb_pixel_total : 20902 time to create 1 rle with old method : 0.024524211883544922 length of segment : 162 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 19304 time to create 1 rle with old method : 0.021648883819580078 length of segment : 194 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1703 time to create 1 rle with old method : 0.0021970272064208984 length of segment : 34 time for calcul the mask position with numpy : 0.00023412704467773438 nb_pixel_total : 11491 time to create 1 rle with old method : 0.013598918914794922 length of segment : 141 time for calcul the mask position with numpy : 0.0017561912536621094 nb_pixel_total : 109171 time to create 1 rle with old method : 0.12743568420410156 length of segment : 520 time for calcul the mask position with numpy : 0.0008296966552734375 nb_pixel_total : 19872 time to create 1 rle with old method : 0.02288031578063965 length of segment : 163 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 3894 time to create 1 rle with old method : 0.004669904708862305 length of segment : 77 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 4106 time to create 1 rle with old method : 0.0048177242279052734 length of segment : 83 time for calcul the mask position with numpy : 0.00043320655822753906 nb_pixel_total : 12118 time to create 1 rle with old method : 0.013939619064331055 length of segment : 131 time for calcul the mask position with numpy : 0.0005068778991699219 nb_pixel_total : 9921 time to create 1 rle with old method : 0.011402368545532227 length of segment : 185 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 2758 time to create 1 rle with old method : 0.0034248828887939453 length of segment : 39 time for calcul the mask position with numpy : 0.00019049644470214844 nb_pixel_total : 6299 time to create 1 rle with old method : 0.007726430892944336 length of segment : 65 time for calcul the mask position with numpy : 0.00021767616271972656 nb_pixel_total : 4593 time to create 1 rle with old method : 0.005467891693115234 length of segment : 83 time for calcul the mask position with numpy : 0.0015645027160644531 nb_pixel_total : 51803 time to create 1 rle with old method : 0.05871295928955078 length of segment : 356 time for calcul the mask position with numpy : 0.00022673606872558594 nb_pixel_total : 11800 time to create 1 rle with old method : 0.013527393341064453 length of segment : 152 time for calcul the mask position with numpy : 0.0009205341339111328 nb_pixel_total : 43414 time to create 1 rle with old method : 0.049987077713012695 length of segment : 220 time for calcul the mask position with numpy : 0.00038933753967285156 nb_pixel_total : 11025 time to create 1 rle with old method : 0.012714147567749023 length of segment : 183 time for calcul the mask position with numpy : 0.0002944469451904297 nb_pixel_total : 4203 time to create 1 rle with old method : 0.005118131637573242 length of segment : 88 time for calcul the mask position with numpy : 0.01641082763671875 nb_pixel_total : 595367 time to create 1 rle with new method : 0.030900239944458008 length of segment : 1410 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 14007 time to create 1 rle with old method : 0.01630377769470215 length of segment : 133 time for calcul the mask position with numpy : 0.002691030502319336 nb_pixel_total : 116471 time to create 1 rle with old method : 0.1412210464477539 length of segment : 516 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 16300 time to create 1 rle with old method : 0.021288156509399414 length of segment : 155 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 10503 time to create 1 rle with old method : 0.01231527328491211 length of segment : 165 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 11850 time to create 1 rle with old method : 0.013704299926757812 length of segment : 138 time for calcul the mask position with numpy : 0.00017905235290527344 nb_pixel_total : 3618 time to create 1 rle with old method : 0.004613161087036133 length of segment : 57 time for calcul the mask position with numpy : 0.0009200572967529297 nb_pixel_total : 10425 time to create 1 rle with old method : 0.012441158294677734 length of segment : 240 time for calcul the mask position with numpy : 0.0026955604553222656 nb_pixel_total : 97367 time to create 1 rle with old method : 0.1101679801940918 length of segment : 516 time for calcul the mask position with numpy : 0.0005838871002197266 nb_pixel_total : 10683 time to create 1 rle with old method : 0.012431144714355469 length of segment : 295 time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 12203 time to create 1 rle with old method : 0.013994693756103516 length of segment : 132 time for calcul the mask position with numpy : 0.0003523826599121094 nb_pixel_total : 7621 time to create 1 rle with old method : 0.009051322937011719 length of segment : 141 time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 14219 time to create 1 rle with old method : 0.016885042190551758 length of segment : 90 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 5331 time to create 1 rle with old method : 0.006430387496948242 length of segment : 113 time for calcul the mask position with numpy : 0.016367197036743164 nb_pixel_total : 767953 time to create 1 rle with new method : 0.09739470481872559 length of segment : 1063 time for calcul the mask position with numpy : 0.00030350685119628906 nb_pixel_total : 8608 time to create 1 rle with old method : 0.010011911392211914 length of segment : 99 time for calcul the mask position with numpy : 0.011487245559692383 nb_pixel_total : 653810 time to create 1 rle with new method : 0.01885080337524414 length of segment : 1051 time for calcul the mask position with numpy : 0.01042795181274414 nb_pixel_total : 697939 time to create 1 rle with new method : 0.017544031143188477 length of segment : 967 time for calcul the mask position with numpy : 0.0005414485931396484 nb_pixel_total : 10662 time to create 1 rle with old method : 0.012266159057617188 length of segment : 175 time for calcul the mask position with numpy : 0.0039577484130859375 nb_pixel_total : 111756 time to create 1 rle with old method : 0.13767623901367188 length of segment : 548 time for calcul the mask position with numpy : 0.0010833740234375 nb_pixel_total : 24041 time to create 1 rle with old method : 0.032193899154663086 length of segment : 244 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 4623 time to create 1 rle with old method : 0.006580352783203125 length of segment : 74 time for calcul the mask position with numpy : 0.00017261505126953125 nb_pixel_total : 4680 time to create 1 rle with old method : 0.005640745162963867 length of segment : 82 time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 3593 time to create 1 rle with old method : 0.00461125373840332 length of segment : 79 time for calcul the mask position with numpy : 0.00038623809814453125 nb_pixel_total : 9779 time to create 1 rle with old method : 0.012527942657470703 length of segment : 121 time for calcul the mask position with numpy : 0.00034332275390625 nb_pixel_total : 6652 time to create 1 rle with old method : 0.007761240005493164 length of segment : 119 time for calcul the mask position with numpy : 0.0008070468902587891 nb_pixel_total : 19789 time to create 1 rle with old method : 0.024487733840942383 length of segment : 388 time for calcul the mask position with numpy : 0.0004265308380126953 nb_pixel_total : 11302 time to create 1 rle with old method : 0.012774229049682617 length of segment : 178 time for calcul the mask position with numpy : 0.0031125545501708984 nb_pixel_total : 111150 time to create 1 rle with old method : 0.1267397403717041 length of segment : 554 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 15421 time to create 1 rle with old method : 0.019145727157592773 length of segment : 111 time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 6549 time to create 1 rle with old method : 0.010085105895996094 length of segment : 122 time for calcul the mask position with numpy : 0.0003986358642578125 nb_pixel_total : 7242 time to create 1 rle with old method : 0.008710145950317383 length of segment : 132 time for calcul the mask position with numpy : 0.00042939186096191406 nb_pixel_total : 9159 time to create 1 rle with old method : 0.010523080825805664 length of segment : 168 time for calcul the mask position with numpy : 0.0003566741943359375 nb_pixel_total : 11148 time to create 1 rle with old method : 0.014559030532836914 length of segment : 133 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 10409 time to create 1 rle with old method : 0.012470006942749023 length of segment : 139 time for calcul the mask position with numpy : 0.0023775100708007812 nb_pixel_total : 110588 time to create 1 rle with old method : 0.12466645240783691 length of segment : 535 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 15409 time to create 1 rle with old method : 0.017668962478637695 length of segment : 143 time for calcul the mask position with numpy : 0.0006210803985595703 nb_pixel_total : 30118 time to create 1 rle with old method : 0.03498649597167969 length of segment : 158 time for calcul the mask position with numpy : 0.015748023986816406 nb_pixel_total : 616665 time to create 1 rle with new method : 0.025779008865356445 length of segment : 1146 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 6877 time to create 1 rle with old method : 0.007970809936523438 length of segment : 82 time for calcul the mask position with numpy : 0.002452850341796875 nb_pixel_total : 109074 time to create 1 rle with old method : 0.13919878005981445 length of segment : 533 time for calcul the mask position with numpy : 0.000732421875 nb_pixel_total : 32865 time to create 1 rle with old method : 0.04159426689147949 length of segment : 197 time spent for convertir_results : 5.884673833847046 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 76 chid ids of type : 3594 Number RLEs to save : 19303 save missing photos in datou_result : time spend for datou_step_exec : 40.445645570755005 time spend to save output : 1.0922274589538574 total time spend for step 1 : 41.53787302970886 step2:crop_condition Tue Sep 2 18:41:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 23 ! batch 1 Loaded 76 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756831276_3746595 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.073975801467896 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756831285_3746595 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.06862473487854 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756831287_3746595 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.800203800201416 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756831306_3746595 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.18807339668274 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756831315_3746595 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1538186073303223 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1380867096, 1380867094, 1380867092, 1380867050, 1380867048, 1380867013, 1380867012, 1380866958, 1380866956, 1380866945, 1380866943, 1380866938, 1380866903, 1380866899, 1380866897, 1380866884, 1380866882, 1380866880, 1380866854, 1380866852, 1380866836, 1380866834, 1380866831] Looping around the photos to save general results len do output : 76 /1380898705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380898995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867096', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867094', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867092', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867050', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867048', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867013', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867012', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866958', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866956', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866945', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866943', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866938', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866903', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866899', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866897', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866884', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866882', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866880', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866854', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866852', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866836', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866834', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866831', None, None, None, None, None, '3653356') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 251 time used for this insertion : 0.026990413665771484 save_final save missing photos in datou_result : time spend for datou_step_exec : 42.295631647109985 time spend to save output : 0.030057668685913086 total time spend for step 2 : 42.3256893157959 step3:rle_unique_nms_with_priority Tue Sep 2 18:41:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 76 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 0.6575181484222412 time for calcul the mask position with numpy : 0.05915212631225586 nb_pixel_total : 1980373 time to create 1 rle with new method : 0.3290717601776123 time for calcul the mask position with numpy : 0.006624460220336914 nb_pixel_total : 8256 time to create 1 rle with old method : 0.009092330932617188 time for calcul the mask position with numpy : 0.006059885025024414 nb_pixel_total : 6850 time to create 1 rle with old method : 0.007762908935546875 time for calcul the mask position with numpy : 0.006362438201904297 nb_pixel_total : 14150 time to create 1 rle with old method : 0.015011072158813477 time for calcul the mask position with numpy : 0.005778074264526367 nb_pixel_total : 17898 time to create 1 rle with old method : 0.0188143253326416 time for calcul the mask position with numpy : 0.005792856216430664 nb_pixel_total : 7108 time to create 1 rle with old method : 0.007758140563964844 time for calcul the mask position with numpy : 0.0061490535736083984 nb_pixel_total : 7825 time to create 1 rle with old method : 0.008722543716430664 time for calcul the mask position with numpy : 0.006052494049072266 nb_pixel_total : 12155 time to create 1 rle with old method : 0.013467073440551758 time for calcul the mask position with numpy : 0.006123542785644531 nb_pixel_total : 9163 time to create 1 rle with old method : 0.00987863540649414 time for calcul the mask position with numpy : 0.005969524383544922 nb_pixel_total : 9822 time to create 1 rle with old method : 0.010927200317382812 create new chi : 0.5558731555938721 time to delete rle : 0.021129846572875977 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 3740 TO DO : save crop sub photo not yet done ! save time : 0.26215267181396484 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.08403301239013672 time for calcul the mask position with numpy : 0.019091367721557617 nb_pixel_total : 1883731 time to create 1 rle with new method : 0.2289881706237793 time for calcul the mask position with numpy : 0.006493330001831055 nb_pixel_total : 62901 time to create 1 rle with old method : 0.06832456588745117 time for calcul the mask position with numpy : 0.007897138595581055 nb_pixel_total : 96569 time to create 1 rle with old method : 0.10214662551879883 time for calcul the mask position with numpy : 0.006432533264160156 nb_pixel_total : 4371 time to create 1 rle with old method : 0.004863739013671875 time for calcul the mask position with numpy : 0.005934953689575195 nb_pixel_total : 1490 time to create 1 rle with old method : 0.0017216205596923828 time for calcul the mask position with numpy : 0.005901813507080078 nb_pixel_total : 17090 time to create 1 rle with old method : 0.018434524536132812 time for calcul the mask position with numpy : 0.005935192108154297 nb_pixel_total : 7448 time to create 1 rle with old method : 0.007904291152954102 create new chi : 0.49071192741394043 time to delete rle : 0.0006196498870849609 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4040 TO DO : save crop sub photo not yet done ! save time : 0.2908642292022705 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06160473823547363 time for calcul the mask position with numpy : 0.01865696907043457 nb_pixel_total : 2048169 time to create 1 rle with new method : 0.0626227855682373 time for calcul the mask position with numpy : 0.006036043167114258 nb_pixel_total : 20902 time to create 1 rle with old method : 0.022481679916381836 time for calcul the mask position with numpy : 0.00600123405456543 nb_pixel_total : 4529 time to create 1 rle with old method : 0.004933357238769531 create new chi : 0.12100529670715332 time to delete rle : 0.0002353191375732422 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1608 TO DO : save crop sub photo not yet done ! save time : 0.14191746711730957 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04514932632446289 time for calcul the mask position with numpy : 0.0190737247467041 nb_pixel_total : 2041102 time to create 1 rle with new method : 0.41851162910461426 time for calcul the mask position with numpy : 0.006188869476318359 nb_pixel_total : 11491 time to create 1 rle with old method : 0.012393712997436523 time for calcul the mask position with numpy : 0.006331443786621094 nb_pixel_total : 1703 time to create 1 rle with old method : 0.0019390583038330078 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 19304 time to create 1 rle with old method : 0.02144336700439453 create new chi : 0.5030348300933838 time to delete rle : 0.0003437995910644531 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1818 TO DO : save crop sub photo not yet done ! save time : 0.1457970142364502 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.30426573753356934 time for calcul the mask position with numpy : 0.06498980522155762 nb_pixel_total : 1924439 time to create 1 rle with new method : 0.17589521408081055 time for calcul the mask position with numpy : 0.007948875427246094 nb_pixel_total : 12118 time to create 1 rle with old method : 0.014617443084716797 time for calcul the mask position with numpy : 0.007188558578491211 nb_pixel_total : 4106 time to create 1 rle with old method : 0.004948854446411133 time for calcul the mask position with numpy : 0.007609128952026367 nb_pixel_total : 3894 time to create 1 rle with old method : 0.0045757293701171875 time for calcul the mask position with numpy : 0.006601810455322266 nb_pixel_total : 19872 time to create 1 rle with old method : 0.02251291275024414 time for calcul the mask position with numpy : 0.007165670394897461 nb_pixel_total : 109171 time to create 1 rle with old method : 0.13544297218322754 create new chi : 0.4713783264160156 time to delete rle : 0.0005114078521728516 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 3028 TO DO : save crop sub photo not yet done ! save time : 0.22942090034484863 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.040585994720458984 time for calcul the mask position with numpy : 0.02034163475036621 nb_pixel_total : 2060921 time to create 1 rle with new method : 0.25491762161254883 time for calcul the mask position with numpy : 0.0057642459869384766 nb_pixel_total : 2758 time to create 1 rle with old method : 0.002817392349243164 time for calcul the mask position with numpy : 0.0056610107421875 nb_pixel_total : 9921 time to create 1 rle with old method : 0.010152578353881836 create new chi : 0.3116188049316406 time to delete rle : 0.0002770423889160156 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1528 TO DO : save crop sub photo not yet done ! save time : 0.14277338981628418 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.27468061447143555 time for calcul the mask position with numpy : 0.05291342735290527 nb_pixel_total : 2009581 time to create 1 rle with new method : 0.20653629302978516 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0015232563018798828 time for calcul the mask position with numpy : 0.005973339080810547 nb_pixel_total : 51803 time to create 1 rle with old method : 0.05521798133850098 time for calcul the mask position with numpy : 0.005961418151855469 nb_pixel_total : 4593 time to create 1 rle with old method : 0.0050258636474609375 time for calcul the mask position with numpy : 0.005695819854736328 nb_pixel_total : 6299 time to create 1 rle with old method : 0.00687408447265625 create new chi : 0.36132311820983887 time to delete rle : 0.00034332275390625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2135 TO DO : save crop sub photo not yet done ! save time : 0.16376876831054688 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.09101581573486328 time for calcul the mask position with numpy : 0.1487574577331543 nb_pixel_total : 1406689 time to create 1 rle with new method : 0.07415103912353516 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 14007 time to create 1 rle with old method : 0.014676570892333984 time for calcul the mask position with numpy : 0.009558439254760742 nb_pixel_total : 594262 time to create 1 rle with new method : 0.22844576835632324 time for calcul the mask position with numpy : 0.006014108657836914 nb_pixel_total : 4203 time to create 1 rle with old method : 0.004724264144897461 time for calcul the mask position with numpy : 0.005990028381347656 nb_pixel_total : 11025 time to create 1 rle with old method : 0.011881113052368164 time for calcul the mask position with numpy : 0.006345987319946289 nb_pixel_total : 43414 time to create 1 rle with old method : 0.04672980308532715 create new chi : 0.573481559753418 time to delete rle : 0.0007369518280029297 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5043 TO DO : save crop sub photo not yet done ! save time : 0.32788991928100586 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07152915000915527 time for calcul the mask position with numpy : 0.023852825164794922 nb_pixel_total : 1914858 time to create 1 rle with new method : 0.06376528739929199 time for calcul the mask position with numpy : 0.006022453308105469 nb_pixel_total : 3618 time to create 1 rle with old method : 0.0039522647857666016 time for calcul the mask position with numpy : 0.005798816680908203 nb_pixel_total : 11850 time to create 1 rle with old method : 0.013002872467041016 time for calcul the mask position with numpy : 0.005911588668823242 nb_pixel_total : 10503 time to create 1 rle with old method : 0.011800527572631836 time for calcul the mask position with numpy : 0.006288766860961914 nb_pixel_total : 16300 time to create 1 rle with old method : 0.01911020278930664 time for calcul the mask position with numpy : 0.0073354244232177734 nb_pixel_total : 116471 time to create 1 rle with old method : 0.1328434944152832 create new chi : 0.3128087520599365 time to delete rle : 0.0004975795745849609 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 3142 TO DO : save crop sub photo not yet done ! save time : 0.2256479263305664 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.043561697006225586 time for calcul the mask position with numpy : 0.22443485260009766 nb_pixel_total : 2063175 time to create 1 rle with new method : 0.2122814655303955 time for calcul the mask position with numpy : 0.005902528762817383 nb_pixel_total : 10425 time to create 1 rle with old method : 0.0112152099609375 create new chi : 0.46261167526245117 time to delete rle : 0.00026988983154296875 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1560 TO DO : save crop sub photo not yet done ! save time : 0.127028226852417 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0855855941772461 time for calcul the mask position with numpy : 0.1939830780029297 nb_pixel_total : 1953347 time to create 1 rle with new method : 0.14937925338745117 time for calcul the mask position with numpy : 0.0063822269439697266 nb_pixel_total : 12203 time to create 1 rle with old method : 0.013356924057006836 time for calcul the mask position with numpy : 0.006367683410644531 nb_pixel_total : 10683 time to create 1 rle with old method : 0.011871337890625 time for calcul the mask position with numpy : 0.0066492557525634766 nb_pixel_total : 97367 time to create 1 rle with old method : 0.11229729652404785 create new chi : 0.5114481449127197 time to delete rle : 0.0004737377166748047 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2966 TO DO : save crop sub photo not yet done ! save time : 0.20656299591064453 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04331469535827637 time for calcul the mask position with numpy : 0.01924872398376465 nb_pixel_total : 2051760 time to create 1 rle with new method : 0.07513093948364258 time for calcul the mask position with numpy : 0.0062143802642822266 nb_pixel_total : 14219 time to create 1 rle with old method : 0.015573978424072266 time for calcul the mask position with numpy : 0.005980730056762695 nb_pixel_total : 7621 time to create 1 rle with old method : 0.008396148681640625 create new chi : 0.13925623893737793 time to delete rle : 0.0003173351287841797 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1542 TO DO : save crop sub photo not yet done ! save time : 0.14675498008728027 No data in photo_id : 1380866903 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04208874702453613 time for calcul the mask position with numpy : 0.018574237823486328 nb_pixel_total : 1305647 time to create 1 rle with new method : 0.17339420318603516 time for calcul the mask position with numpy : 0.01170492172241211 nb_pixel_total : 762622 time to create 1 rle with new method : 0.07199645042419434 time for calcul the mask position with numpy : 0.006217479705810547 nb_pixel_total : 5331 time to create 1 rle with old method : 0.006060600280761719 create new chi : 0.29738378524780273 time to delete rle : 0.0005009174346923828 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3432 TO DO : save crop sub photo not yet done ! save time : 0.23566222190856934 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.19834542274475098 time for calcul the mask position with numpy : 0.013820171356201172 nb_pixel_total : 713243 time to create 1 rle with new method : 0.20629382133483887 time for calcul the mask position with numpy : 0.01504659652709961 nb_pixel_total : 697939 time to create 1 rle with new method : 0.07356142997741699 time for calcul the mask position with numpy : 0.010200977325439453 nb_pixel_total : 653810 time to create 1 rle with new method : 0.027696847915649414 time for calcul the mask position with numpy : 0.005980491638183594 nb_pixel_total : 8608 time to create 1 rle with old method : 0.009268999099731445 create new chi : 0.3690943717956543 time to delete rle : 0.001132965087890625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 5314 TO DO : save crop sub photo not yet done ! save time : 0.3213655948638916 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.4559895992279053 time for calcul the mask position with numpy : 0.23211264610290527 nb_pixel_total : 1904466 time to create 1 rle with new method : 0.07285451889038086 time for calcul the mask position with numpy : 0.00600743293762207 nb_pixel_total : 9779 time to create 1 rle with old method : 0.01057744026184082 time for calcul the mask position with numpy : 0.005652904510498047 nb_pixel_total : 3593 time to create 1 rle with old method : 0.003890514373779297 time for calcul the mask position with numpy : 0.005723237991333008 nb_pixel_total : 4680 time to create 1 rle with old method : 0.005026578903198242 time for calcul the mask position with numpy : 0.0057375431060791016 nb_pixel_total : 4623 time to create 1 rle with old method : 0.005327701568603516 time for calcul the mask position with numpy : 0.005948066711425781 nb_pixel_total : 24041 time to create 1 rle with old method : 0.02554154396057129 time for calcul the mask position with numpy : 0.0070400238037109375 nb_pixel_total : 111756 time to create 1 rle with old method : 0.11918425559997559 time for calcul the mask position with numpy : 0.006392478942871094 nb_pixel_total : 10662 time to create 1 rle with old method : 0.011867284774780273 create new chi : 0.5390570163726807 time to delete rle : 0.0006010532379150391 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 3726 TO DO : save crop sub photo not yet done ! save time : 0.2660238742828369 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039212942123413086 time for calcul the mask position with numpy : 0.018975019454956055 nb_pixel_total : 2047159 time to create 1 rle with new method : 0.02809929847717285 time for calcul the mask position with numpy : 0.005986213684082031 nb_pixel_total : 19789 time to create 1 rle with old method : 0.02071070671081543 time for calcul the mask position with numpy : 0.005776882171630859 nb_pixel_total : 6652 time to create 1 rle with old method : 0.0071451663970947266 create new chi : 0.08702325820922852 time to delete rle : 0.0003190040588378906 batch 1 Loaded 5 chid ids of type : 3594 ++++++++Number RLEs to save : 2094 TO DO : save crop sub photo not yet done ! save time : 0.16400527954101562 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03185915946960449 time for calcul the mask position with numpy : 0.0184934139251709 nb_pixel_total : 2062298 time to create 1 rle with new method : 0.026978015899658203 time for calcul the mask position with numpy : 0.0062029361724853516 nb_pixel_total : 11302 time to create 1 rle with old method : 0.012176752090454102 create new chi : 0.07082772254943848 time to delete rle : 0.00022530555725097656 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1436 TO DO : save crop sub photo not yet done ! save time : 0.12098956108093262 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03251791000366211 time for calcul the mask position with numpy : 0.018111705780029297 nb_pixel_total : 1962450 time to create 1 rle with new method : 0.20523285865783691 time for calcul the mask position with numpy : 0.0063762664794921875 nb_pixel_total : 111150 time to create 1 rle with old method : 0.11645936965942383 create new chi : 0.3531053066253662 time to delete rle : 0.0003216266632080078 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2188 TO DO : save crop sub photo not yet done ! save time : 0.16834425926208496 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.22638273239135742 time for calcul the mask position with numpy : 0.06339263916015625 nb_pixel_total : 2035229 time to create 1 rle with new method : 0.2534356117248535 time for calcul the mask position with numpy : 0.006200075149536133 nb_pixel_total : 9159 time to create 1 rle with old method : 0.010064840316772461 time for calcul the mask position with numpy : 0.00597071647644043 nb_pixel_total : 7242 time to create 1 rle with old method : 0.008114099502563477 time for calcul the mask position with numpy : 0.0058858394622802734 nb_pixel_total : 6549 time to create 1 rle with old method : 0.0069370269775390625 time for calcul the mask position with numpy : 0.0058803558349609375 nb_pixel_total : 15421 time to create 1 rle with old method : 0.017111778259277344 create new chi : 0.3930530548095703 time to delete rle : 0.0004134178161621094 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2146 TO DO : save crop sub photo not yet done ! save time : 0.17958354949951172 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04735207557678223 time for calcul the mask position with numpy : 0.21158456802368164 nb_pixel_total : 1941455 time to create 1 rle with new method : 0.07651019096374512 time for calcul the mask position with numpy : 0.0063686370849609375 nb_pixel_total : 110588 time to create 1 rle with old method : 0.11998605728149414 time for calcul the mask position with numpy : 0.0060923099517822266 nb_pixel_total : 10409 time to create 1 rle with old method : 0.011760473251342773 time for calcul the mask position with numpy : 0.006996870040893555 nb_pixel_total : 11148 time to create 1 rle with old method : 0.012326717376708984 create new chi : 0.4618966579437256 time to delete rle : 0.0004563331604003906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2694 TO DO : save crop sub photo not yet done ! save time : 0.20378971099853516 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0726931095123291 time for calcul the mask position with numpy : 0.17914223670959473 nb_pixel_total : 1302334 time to create 1 rle with new method : 0.07555007934570312 time for calcul the mask position with numpy : 0.006391286849975586 nb_pixel_total : 109074 time to create 1 rle with old method : 0.11455106735229492 time for calcul the mask position with numpy : 0.01054072380065918 nb_pixel_total : 616665 time to create 1 rle with new method : 0.1596541404724121 time for calcul the mask position with numpy : 0.00595855712890625 nb_pixel_total : 30118 time to create 1 rle with old method : 0.03233909606933594 time for calcul the mask position with numpy : 0.006018161773681641 nb_pixel_total : 15409 time to create 1 rle with old method : 0.016732215881347656 create new chi : 0.6162240505218506 time to delete rle : 0.0007665157318115234 batch 1 Loaded 10 chid ids of type : 3594 +++++++Number RLEs to save : 5040 TO DO : save crop sub photo not yet done ! save time : 0.34074997901916504 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03911709785461426 time for calcul the mask position with numpy : 0.018619298934936523 nb_pixel_total : 2040735 time to create 1 rle with new method : 0.07025885581970215 time for calcul the mask position with numpy : 0.0061016082763671875 nb_pixel_total : 32865 time to create 1 rle with old method : 0.03373360633850098 create new chi : 0.13565540313720703 time to delete rle : 0.0002319812774658203 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1474 TO DO : save crop sub photo not yet done ! save time : 0.131103515625 map_output_result : {1380867096: (0.0, 'Should be the crop_list due to order', 0), 1380867094: (0.0, 'Should be the crop_list due to order', 0), 1380867092: (0.0, 'Should be the crop_list due to order', 0), 1380867050: (0.0, 'Should be the crop_list due to order', 0), 1380867048: (0.0, 'Should be the crop_list due to order', 0), 1380867013: (0.0, 'Should be the crop_list due to order', 0), 1380867012: (0.0, 'Should be the crop_list due to order', 0), 1380866958: (0.0, 'Should be the crop_list due to order', 0), 1380866956: (0.0, 'Should be the crop_list due to order', 0), 1380866945: (0.0, 'Should be the crop_list due to order', 0), 1380866943: (0.0, 'Should be the crop_list due to order', 0), 1380866938: (0.0, 'Should be the crop_list due to order', 0), 1380866903: (0.0, 'Should be the crop_list due to order', 0.0), 1380866899: (0.0, 'Should be the crop_list due to order', 0), 1380866897: (0.0, 'Should be the crop_list due to order', 0), 1380866884: (0.0, 'Should be the crop_list due to order', 0), 1380866882: (0.0, 'Should be the crop_list due to order', 0), 1380866880: (0.0, 'Should be the crop_list due to order', 0), 1380866854: (0.0, 'Should be the crop_list due to order', 0), 1380866852: (0.0, 'Should be the crop_list due to order', 0), 1380866836: (0.0, 'Should be the crop_list due to order', 0), 1380866834: (0.0, 'Should be the crop_list due to order', 0), 1380866831: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1380867096, 1380867094, 1380867092, 1380867050, 1380867048, 1380867013, 1380867012, 1380866958, 1380866956, 1380866945, 1380866943, 1380866938, 1380866903, 1380866899, 1380866897, 1380866884, 1380866882, 1380866880, 1380866854, 1380866852, 1380866836, 1380866834, 1380866831] Looping around the photos to save general results len do output : 23 /1380867096.Didn't retrieve data . /1380867094.Didn't retrieve data . /1380867092.Didn't retrieve data . /1380867050.Didn't retrieve data . /1380867048.Didn't retrieve data . /1380867013.Didn't retrieve data . /1380867012.Didn't retrieve data . /1380866958.Didn't retrieve data . /1380866956.Didn't retrieve data . /1380866945.Didn't retrieve data . /1380866943.Didn't retrieve data . /1380866938.Didn't retrieve data . /1380866903.Didn't retrieve data . /1380866899.Didn't retrieve data . /1380866897.Didn't retrieve data . /1380866884.Didn't retrieve data . /1380866882.Didn't retrieve data . /1380866880.Didn't retrieve data . /1380866854.Didn't retrieve data . /1380866852.Didn't retrieve data . /1380866836.Didn't retrieve data . /1380866834.Didn't retrieve data . /1380866831.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867096', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867094', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867092', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867050', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867048', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867013', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867012', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866958', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866956', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866945', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866943', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866938', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866903', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866899', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866897', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866884', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866882', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866880', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866854', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866852', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866836', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866834', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866831', None, None, None, None, None, '3653356') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.015361785888671875 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.35164475440979 time spend to save output : 0.016310930252075195 total time spend for step 3 : 16.367955684661865 step4:ventilate_hashtags_in_portfolio Tue Sep 2 18:42:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26450291 get user id for portfolio 26450291 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26450291 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','background','carton','pehd','flou','environnement','papier','pet_fonce','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26450291 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','background','carton','pehd','flou','environnement','papier','pet_fonce','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26450291 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','mal_croppe','background','carton','pehd','flou','environnement','papier','pet_fonce','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26450475,26450476,26450477,26450478,26450479,26450480,26450481,26450482,26450483,26450484,26450485?tags=metal,mal_croppe,background,carton,pehd,flou,environnement,papier,pet_fonce,pet_clair,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1380867096, 1380867094, 1380867092, 1380867050, 1380867048, 1380867013, 1380867012, 1380866958, 1380866956, 1380866945, 1380866943, 1380866938, 1380866903, 1380866899, 1380866897, 1380866884, 1380866882, 1380866880, 1380866854, 1380866852, 1380866836, 1380866834, 1380866831] Looping around the photos to save general results len do output : 1 /26450291. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867096', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867094', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867092', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867050', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867048', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867013', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867012', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866958', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866956', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866945', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866943', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866938', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866903', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866899', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866897', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866884', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866882', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866880', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866854', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866852', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866836', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866834', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866831', None, None, None, None, None, '3653356') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.019415855407714844 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.731658697128296 time spend to save output : 0.019744396209716797 total time spend for step 4 : 1.7514030933380127 step5:final Tue Sep 2 18:42:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1380867096: ('0.10412554934916803',), 1380867094: ('0.10412554934916803',), 1380867092: ('0.10412554934916803',), 1380867050: ('0.10412554934916803',), 1380867048: ('0.10412554934916803',), 1380867013: ('0.10412554934916803',), 1380867012: ('0.10412554934916803',), 1380866958: ('0.10412554934916803',), 1380866956: ('0.10412554934916803',), 1380866945: ('0.10412554934916803',), 1380866943: ('0.10412554934916803',), 1380866938: ('0.10412554934916803',), 1380866903: ('0.10412554934916803',), 1380866899: ('0.10412554934916803',), 1380866897: ('0.10412554934916803',), 1380866884: ('0.10412554934916803',), 1380866882: ('0.10412554934916803',), 1380866880: ('0.10412554934916803',), 1380866854: ('0.10412554934916803',), 1380866852: ('0.10412554934916803',), 1380866836: ('0.10412554934916803',), 1380866834: ('0.10412554934916803',), 1380866831: ('0.10412554934916803',)} new output for save of step final : {1380867096: ('0.10412554934916803',), 1380867094: ('0.10412554934916803',), 1380867092: ('0.10412554934916803',), 1380867050: ('0.10412554934916803',), 1380867048: ('0.10412554934916803',), 1380867013: ('0.10412554934916803',), 1380867012: ('0.10412554934916803',), 1380866958: ('0.10412554934916803',), 1380866956: ('0.10412554934916803',), 1380866945: ('0.10412554934916803',), 1380866943: ('0.10412554934916803',), 1380866938: ('0.10412554934916803',), 1380866903: ('0.10412554934916803',), 1380866899: ('0.10412554934916803',), 1380866897: ('0.10412554934916803',), 1380866884: ('0.10412554934916803',), 1380866882: ('0.10412554934916803',), 1380866880: ('0.10412554934916803',), 1380866854: ('0.10412554934916803',), 1380866852: ('0.10412554934916803',), 1380866836: ('0.10412554934916803',), 1380866834: ('0.10412554934916803',), 1380866831: ('0.10412554934916803',)} [1380867096, 1380867094, 1380867092, 1380867050, 1380867048, 1380867013, 1380867012, 1380866958, 1380866956, 1380866945, 1380866943, 1380866938, 1380866903, 1380866899, 1380866897, 1380866884, 1380866882, 1380866880, 1380866854, 1380866852, 1380866836, 1380866834, 1380866831] Looping around the photos to save general results len do output : 23 /1380867096.Didn't retrieve data . /1380867094.Didn't retrieve data . /1380867092.Didn't retrieve data . /1380867050.Didn't retrieve data . /1380867048.Didn't retrieve data . /1380867013.Didn't retrieve data . /1380867012.Didn't retrieve data . /1380866958.Didn't retrieve data . /1380866956.Didn't retrieve data . /1380866945.Didn't retrieve data . /1380866943.Didn't retrieve data . /1380866938.Didn't retrieve data . /1380866903.Didn't retrieve data . /1380866899.Didn't retrieve data . /1380866897.Didn't retrieve data . /1380866884.Didn't retrieve data . /1380866882.Didn't retrieve data . /1380866880.Didn't retrieve data . /1380866854.Didn't retrieve data . /1380866852.Didn't retrieve data . /1380866836.Didn't retrieve data . /1380866834.Didn't retrieve data . /1380866831.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867096', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867094', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867092', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867050', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867048', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867013', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867012', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866958', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866956', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866945', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866943', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866938', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866903', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866899', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866897', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866884', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866882', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866880', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866854', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866852', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866836', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866834', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866831', None, None, None, None, None, '3653356') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.014958858489990234 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12546515464782715 time spend to save output : 0.0159454345703125 total time spend for step 5 : 0.14141058921813965 step6:blur_detection Tue Sep 2 18:42:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e.jpg resize: (1080, 1920) 1380867096 0.9778689877635656 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae.jpg resize: (1080, 1920) 1380867094 4.615818383742761 treat image : temp/1756831229_3746595_1380867092_845812aefb6b128647369ab5dfa71134.jpg resize: (1080, 1920) 1380867092 -0.6259857132393366 treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676.jpg resize: (1080, 1920) 1380867050 -0.33197908008043714 treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69.jpg resize: (1080, 1920) 1380867048 -3.465754081347133 treat image : temp/1756831229_3746595_1380867013_f9797f690b243ab462814376e8310b8d.jpg resize: (1080, 1920) 1380867013 0.8054596250466988 treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0.jpg resize: (1080, 1920) 1380867012 1.040943543147105 treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c.jpg resize: (1080, 1920) 1380866958 0.49544538398127447 treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3.jpg resize: (1080, 1920) 1380866956 -3.6716773048035 treat image : temp/1756831229_3746595_1380866945_9efaf889dae384cb133c8af258ea74d5.jpg resize: (1080, 1920) 1380866945 2.1207114421735898 treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8.jpg resize: (1080, 1920) 1380866943 -0.1936972953277385 treat image : temp/1756831229_3746595_1380866938_1086fa87b6d31b8ed72001ef3db200dd.jpg resize: (1080, 1920) 1380866938 0.07876941076071063 treat image : temp/1756831229_3746595_1380866903_553e1f58f92211f90aceaf7de02e2480.jpg resize: (1080, 1920) 1380866903 -0.02587473548652636 treat image : temp/1756831229_3746595_1380866899_94c5c5f9d3ef20923fd6024756adc2fd.jpg resize: (1080, 1920) 1380866899 2.122662963978461 treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882.jpg resize: (1080, 1920) 1380866897 1.0316531687778308 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e.jpg resize: (1080, 1920) 1380866884 -1.2075481407434328 treat image : temp/1756831229_3746595_1380866882_0491587a4a5d5c672f391a455af9f2d2.jpg resize: (1080, 1920) 1380866882 0.6880757259766359 treat image : temp/1756831229_3746595_1380866880_ca603e3c1a9291339628cf450860e4b0.jpg resize: (1080, 1920) 1380866880 1.2046423844423932 treat image : temp/1756831229_3746595_1380866854_3a814caa757d84764e86e0e380734525.jpg resize: (1080, 1920) 1380866854 0.9156385234055987 treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94.jpg resize: (1080, 1920) 1380866852 -3.3995202740615498 treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da.jpg resize: (1080, 1920) 1380866836 2.0408568533768285 treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53.jpg resize: (1080, 1920) 1380866834 0.38792856071815784 treat image : temp/1756831229_3746595_1380866831_f680c0188fd3efed4a3a099fe8428b26.jpg resize: (1080, 1920) 1380866831 0.30346025469377874 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807588_0.png resize: (199, 117) 1380898705 -1.8846663204085405 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807589_0.png resize: (109, 131) 1380898706 -0.44449235227207856 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807590_0.png resize: (176, 169) 1380898707 -1.74122364979963 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807592_0.png resize: (77, 165) 1380898708 -2.0761294827221213 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807596_0.png resize: (224, 149) 1380898709 -2.283674539423766 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807597_0.png resize: (176, 110) 1380898710 -1.9514358969228007 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807598_0.png resize: (148, 154) 1380898711 1.2701974331925037 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807599_0.png resize: (139, 60) 1380898712 2.8553321358705426 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807600_0.png resize: (156, 65) 1380898713 -2.7982236163218843 treat image : temp/1756831229_3746595_1380867092_845812aefb6b128647369ab5dfa71134_rle_crop_3940807603_0.png resize: (102, 82) 1380898714 -1.1928019427035788 treat image : temp/1756831229_3746595_1380867092_845812aefb6b128647369ab5dfa71134_rle_crop_3940807604_0.png resize: (162, 199) 1380898715 -1.5444372914513396 treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676_rle_crop_3940807606_0.png resize: (32, 69) 1380898716 20.0 treat image : temp/1756831229_3746595_1380867013_f9797f690b243ab462814376e8310b8d_rle_crop_3940807613_0.png resize: (185, 114) 1380898717 -1.590309356923614 treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807615_0.png resize: (64, 142) 1380898718 -0.49591493320431784 treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807620_0.png resize: (183, 116) 1380898721 -1.4804561025204088 treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807623_0.png resize: (118, 184) 1380898722 -0.7755928077313679 treat image : temp/1756831229_3746595_1380866945_9efaf889dae384cb133c8af258ea74d5_rle_crop_3940807629_0.png resize: (229, 209) 1380898723 0.09518603061328136 treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8_rle_crop_3940807631_0.png resize: (225, 126) 1380898724 -2.5490327504691996 treat image : temp/1756831229_3746595_1380866938_1086fa87b6d31b8ed72001ef3db200dd_rle_crop_3940807633_0.png resize: (141, 116) 1380898725 0.13281337274991614 treat image : temp/1756831229_3746595_1380866938_1086fa87b6d31b8ed72001ef3db200dd_rle_crop_3940807634_0.png resize: (82, 220) 1380898726 1.4501697851968833 treat image : temp/1756831229_3746595_1380866899_94c5c5f9d3ef20923fd6024756adc2fd_rle_crop_3940807635_0.png resize: (108, 101) 1380898727 -1.564247351785645 treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882_rle_crop_3940807637_0.png resize: (99, 132) 1380898728 0.2302681308536484 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807640_0.png resize: (175, 117) 1380898729 -2.299157918377471 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807643_0.png resize: (74, 87) 1380898730 -0.5883681251085099 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807644_0.png resize: (80, 88) 1380898731 -2.260953738771466 treat image : temp/1756831229_3746595_1380866882_0491587a4a5d5c672f391a455af9f2d2_rle_crop_3940807647_0.png resize: (118, 144) 1380898732 -1.3121610932155001 treat image : temp/1756831229_3746595_1380866880_ca603e3c1a9291339628cf450860e4b0_rle_crop_3940807649_0.png resize: (179, 108) 1380898733 -0.1616814323907834 treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807651_0.png resize: (111, 152) 1380898734 0.9041471077453204 treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807652_0.png resize: (122, 80) 1380898735 -2.0803747904606875 treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807653_0.png resize: (105, 181) 1380898736 -2.34328535025218 treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da_rle_crop_3940807656_0.png resize: (139, 138) 1380898737 -0.8226603716611328 treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807659_0.png resize: (154, 260) 1380898738 -0.2621866141101181 treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807661_0.png resize: (77, 108) 1380898739 -0.26319276026037647 treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676_rle_crop_3940807607_0.png resize: (140, 112) 1380898740 -0.6676458126004072 treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807621_0.png resize: (88, 80) 1380898741 -1.5799564313707821 treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da_rle_crop_3940807657_0.png resize: (534, 340) 1380898742 0.4262930132549394 treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807611_0.png resize: (83, 67) 1380898753 -4.6323343439123 treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807616_0.png resize: (83, 71) 1380898755 -0.7659307772274365 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807591_0.png resize: (102, 99) 1380898935 -1.4273220251279515 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807593_0.png resize: (191, 123) 1380898936 -1.0883541404134125 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807594_0.png resize: (136, 132) 1380898937 -1.9025458639345731 treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807595_0.png resize: (73, 175) 1380898939 -2.721331917959829 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807601_0.png resize: (545, 319) 1380898940 0.2339102575936719 treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807602_0.png resize: (334, 509) 1380898941 -0.2911776258533573 treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676_rle_crop_3940807605_0.png resize: (194, 128) 1380898942 -0.47833939010921706 treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807608_0.png resize: (520, 342) 1380898944 -0.18669494951783797 treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807609_0.png resize: (134, 310) 1380898945 -3.264513275683202 treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807610_0.png resize: (77, 71) 1380898946 -4.448919932021128 treat image : temp/1756831229_3746595_1380867013_f9797f690b243ab462814376e8310b8d_rle_crop_3940807614_0.png resize: (39, 83) 1380898948 0.36687672519890113 treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807617_0.png resize: (350, 242) 1380898949 -0.7374944584629043 treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807618_0.png resize: (150, 95) 1380898950 2.0171454970679297 treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807619_0.png resize: (219, 284) 1380898952 -0.9255784035066177 treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807622_0.png resize: (937, 1027) 1380898953 -0.2877411139173431 treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807624_0.png resize: (515, 340) 1380898954 0.35283361363471427 treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807625_0.png resize: (144, 177) 1380898956 -2.9763955579834036 treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807626_0.png resize: (156, 153) 1380898957 -3.000241607771827 treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807627_0.png resize: (137, 119) 1380898958 -3.33454066196915 treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8_rle_crop_3940807630_0.png resize: (508, 323) 1380898960 0.3171109654883242 treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8_rle_crop_3940807632_0.png resize: (132, 118) 1380898961 -3.2166059530540236 treat image : temp/1756831229_3746595_1380866899_94c5c5f9d3ef20923fd6024756adc2fd_rle_crop_3940807636_0.png resize: (981, 956) 1380898962 0.09275798236008219 treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882_rle_crop_3940807638_0.png resize: (1002, 779) 1380898964 -0.1268860545462798 treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882_rle_crop_3940807639_0.png resize: (962, 953) 1380898965 0.6051077093870589 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807641_0.png resize: (548, 351) 1380898966 0.6518428260721486 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807642_0.png resize: (222, 239) 1380898967 -1.6612061283568385 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807646_0.png resize: (120, 110) 1380898969 -2.4577012845681288 treat image : temp/1756831229_3746595_1380866882_0491587a4a5d5c672f391a455af9f2d2_rle_crop_3940807648_0.png resize: (180, 218) 1380898971 -2.3302449805423775 treat image : temp/1756831229_3746595_1380866854_3a814caa757d84764e86e0e380734525_rle_crop_3940807650_0.png resize: (546, 335) 1380898972 0.42845728073101846 treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807654_0.png resize: (168, 78) 1380898974 -3.604032260453159 treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da_rle_crop_3940807655_0.png resize: (132, 113) 1380898975 -1.8549005711720945 treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807658_0.png resize: (135, 152) 1380898976 -2.0386999968519803 treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807660_0.png resize: (786, 1180) 1380898978 -1.282391427567609 treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807662_0.png resize: (528, 332) 1380898979 0.576761581106978 treat image : temp/1756831229_3746595_1380866831_f680c0188fd3efed4a3a099fe8428b26_rle_crop_3940807663_0.png resize: (195, 248) 1380898980 -0.5095737703588014 treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807612_0.png resize: (131, 117) 1380898992 -3.800416045135437 treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807628_0.png resize: (57, 85) 1380898993 -2.358452776257722 treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807645_0.png resize: (74, 65) 1380898995 0.5405750698641787 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.01453399658203125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.016040325164794922 save missing photos in datou_result : time spend for datou_step_exec : 21.246715784072876 time spend to save output : 0.036028146743774414 total time spend for step 6 : 21.28274393081665 step7:brightness Tue Sep 2 18:42:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e.jpg treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae.jpg treat image : temp/1756831229_3746595_1380867092_845812aefb6b128647369ab5dfa71134.jpg treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676.jpg treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69.jpg treat image : temp/1756831229_3746595_1380867013_f9797f690b243ab462814376e8310b8d.jpg treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0.jpg treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c.jpg treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3.jpg treat image : temp/1756831229_3746595_1380866945_9efaf889dae384cb133c8af258ea74d5.jpg treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8.jpg treat image : temp/1756831229_3746595_1380866938_1086fa87b6d31b8ed72001ef3db200dd.jpg treat image : temp/1756831229_3746595_1380866903_553e1f58f92211f90aceaf7de02e2480.jpg treat image : temp/1756831229_3746595_1380866899_94c5c5f9d3ef20923fd6024756adc2fd.jpg treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882.jpg treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e.jpg treat image : temp/1756831229_3746595_1380866882_0491587a4a5d5c672f391a455af9f2d2.jpg treat image : temp/1756831229_3746595_1380866880_ca603e3c1a9291339628cf450860e4b0.jpg treat image : temp/1756831229_3746595_1380866854_3a814caa757d84764e86e0e380734525.jpg treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94.jpg treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da.jpg treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53.jpg treat image : temp/1756831229_3746595_1380866831_f680c0188fd3efed4a3a099fe8428b26.jpg treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807588_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807589_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807590_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807592_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807596_0.png treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807597_0.png treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807598_0.png treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807599_0.png treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807600_0.png treat image : temp/1756831229_3746595_1380867092_845812aefb6b128647369ab5dfa71134_rle_crop_3940807603_0.png treat image : temp/1756831229_3746595_1380867092_845812aefb6b128647369ab5dfa71134_rle_crop_3940807604_0.png treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676_rle_crop_3940807606_0.png treat image : temp/1756831229_3746595_1380867013_f9797f690b243ab462814376e8310b8d_rle_crop_3940807613_0.png treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807615_0.png treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807620_0.png treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807623_0.png treat image : temp/1756831229_3746595_1380866945_9efaf889dae384cb133c8af258ea74d5_rle_crop_3940807629_0.png treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8_rle_crop_3940807631_0.png treat image : temp/1756831229_3746595_1380866938_1086fa87b6d31b8ed72001ef3db200dd_rle_crop_3940807633_0.png treat image : temp/1756831229_3746595_1380866938_1086fa87b6d31b8ed72001ef3db200dd_rle_crop_3940807634_0.png treat image : temp/1756831229_3746595_1380866899_94c5c5f9d3ef20923fd6024756adc2fd_rle_crop_3940807635_0.png treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882_rle_crop_3940807637_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807640_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807643_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807644_0.png treat image : temp/1756831229_3746595_1380866882_0491587a4a5d5c672f391a455af9f2d2_rle_crop_3940807647_0.png treat image : temp/1756831229_3746595_1380866880_ca603e3c1a9291339628cf450860e4b0_rle_crop_3940807649_0.png treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807651_0.png treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807652_0.png treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807653_0.png treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da_rle_crop_3940807656_0.png treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807659_0.png treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807661_0.png treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676_rle_crop_3940807607_0.png treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807621_0.png treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da_rle_crop_3940807657_0.png treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807611_0.png treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807616_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807591_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807593_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807594_0.png treat image : temp/1756831229_3746595_1380867096_2cfd9a4782386975fbabf222fa1ed11e_rle_crop_3940807595_0.png treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807601_0.png treat image : temp/1756831229_3746595_1380867094_103f8e490d6eecd8802769229fbd73ae_rle_crop_3940807602_0.png treat image : temp/1756831229_3746595_1380867050_26f9323358040e6e5352f415e74cf676_rle_crop_3940807605_0.png treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807608_0.png treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807609_0.png treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807610_0.png treat image : temp/1756831229_3746595_1380867013_f9797f690b243ab462814376e8310b8d_rle_crop_3940807614_0.png treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807617_0.png treat image : temp/1756831229_3746595_1380867012_c060e1d7369eca396bb5f258f4c600a0_rle_crop_3940807618_0.png treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807619_0.png treat image : temp/1756831229_3746595_1380866958_1eb9c6569ee9040a1e470f3f1d8a943c_rle_crop_3940807622_0.png treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807624_0.png treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807625_0.png treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807626_0.png treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807627_0.png treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8_rle_crop_3940807630_0.png treat image : temp/1756831229_3746595_1380866943_6ac1292d0e45ec055214e09d67c797a8_rle_crop_3940807632_0.png treat image : temp/1756831229_3746595_1380866899_94c5c5f9d3ef20923fd6024756adc2fd_rle_crop_3940807636_0.png treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882_rle_crop_3940807638_0.png treat image : temp/1756831229_3746595_1380866897_80f4973875d92fc0d1ce484d5bb08882_rle_crop_3940807639_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807641_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807642_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807646_0.png treat image : temp/1756831229_3746595_1380866882_0491587a4a5d5c672f391a455af9f2d2_rle_crop_3940807648_0.png treat image : temp/1756831229_3746595_1380866854_3a814caa757d84764e86e0e380734525_rle_crop_3940807650_0.png treat image : temp/1756831229_3746595_1380866852_1570d6cc7d00c699c172c89d98cbcf94_rle_crop_3940807654_0.png treat image : temp/1756831229_3746595_1380866836_56960e5c3fcc271ad12d20a1f82aa4da_rle_crop_3940807655_0.png treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807658_0.png treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807660_0.png treat image : temp/1756831229_3746595_1380866834_8a1d72879078f0e21a628d96e99a3c53_rle_crop_3940807662_0.png treat image : temp/1756831229_3746595_1380866831_f680c0188fd3efed4a3a099fe8428b26_rle_crop_3940807663_0.png treat image : temp/1756831229_3746595_1380867048_cd0bbf980062c746f77569a4f1281f69_rle_crop_3940807612_0.png treat image : temp/1756831229_3746595_1380866956_5ecf8929b148841b1cbb310a0d4207c3_rle_crop_3940807628_0.png treat image : temp/1756831229_3746595_1380866884_4eb2b00b0877e70bc4d6ddb4c25a3b5e_rle_crop_3940807645_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.016857385635375977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.017822265625 save missing photos in datou_result : time spend for datou_step_exec : 5.770111560821533 time spend to save output : 0.03920245170593262 total time spend for step 7 : 5.809314012527466 step8:velours_tree Tue Sep 2 18:42:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09451103210449219 time spend to save output : 4.124641418457031e-05 total time spend for step 8 : 0.09455227851867676 step9:send_mail_cod Tue Sep 2 18:42:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26450291_02-09-2025_18_42_41.pdf 26450475 change filename to text .change filename to text .imagette264504751756831361 26450476 imagette264504761756831362 26450477 imagette264504771756831362 26450478 change filename to text .change filename to text .change filename to text .imagette264504781756831362 26450479 imagette264504791756831362 26450480 imagette264504801756831362 26450482 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264504821756831362 26450483 imagette264504831756831363 26450484 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264504841756831363 26450485 change filename to text .change filename to text .change filename to text .imagette264504851756831364 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26450291 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26450475,26450476,26450477,26450478,26450479,26450480,26450481,26450482,26450483,26450484,26450485?tags=metal,mal_croppe,background,carton,pehd,flou,environnement,papier,pet_fonce,pet_clair,autre args[1380867096] : ((1380867096, 0.9778689877635656, 492688767), (1380867096, 0.5054071514880519, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380867094] : ((1380867094, 4.615818383742761, 492688767), (1380867094, 0.5221715429246447, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380867092] : ((1380867092, -0.6259857132393366, 492688767), (1380867092, 0.840770710279253, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380867050] : ((1380867050, -0.33197908008043714, 492688767), (1380867050, 0.5414646831328306, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380867048] : ((1380867048, -3.465754081347133, 492609224), (1380867048, 0.6554118788498201, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380867013] : ((1380867013, 0.8054596250466988, 492688767), (1380867013, 0.537864469419597, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380867012] : ((1380867012, 1.040943543147105, 492688767), (1380867012, 0.8824278348709664, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866958] : ((1380866958, 0.49544538398127447, 492688767), (1380866958, 0.4646070904949419, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866956] : ((1380866956, -3.6716773048035, 492609224), (1380866956, 0.6585056318931217, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866945] : ((1380866945, 2.1207114421735898, 492688767), (1380866945, 0.5016052707374644, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866943] : ((1380866943, -0.1936972953277385, 492688767), (1380866943, 0.6634771605679994, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866938] : ((1380866938, 0.07876941076071063, 492688767), (1380866938, 0.9951924977416432, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866903] : ((1380866903, -0.02587473548652636, 492688767), (1380866903, 1.0373111001661734, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866899] : ((1380866899, 2.122662963978461, 492688767), (1380866899, 0.7012044191078229, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866897] : ((1380866897, 1.0316531687778308, 492688767), (1380866897, 0.8037874434823301, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866884] : ((1380866884, -1.2075481407434328, 492688767), (1380866884, 0.7123332311480423, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866882] : ((1380866882, 0.6880757259766359, 492688767), (1380866882, 0.7709143699590963, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866880] : ((1380866880, 1.2046423844423932, 492688767), (1380866880, 0.9079888333519537, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866854] : ((1380866854, 0.9156385234055987, 492688767), (1380866854, 0.5184064409117233, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866852] : ((1380866852, -3.3995202740615498, 492609224), (1380866852, 0.6194745778785471, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866836] : ((1380866836, 2.0408568533768285, 492688767), (1380866836, 0.4981669168135114, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866834] : ((1380866834, 0.38792856071815784, 492688767), (1380866834, 0.7196049291072941, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com args[1380866831] : ((1380866831, 0.30346025469377874, 492688767), (1380866831, 1.2413887199121234, 2107752395), '0.10412554934916803') We are sending mail with results at report@fotonower.com refus_total : 0.10412554934916803 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26450291 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26450291_02-09-2025_18_42_41.pdf results_Auto_P26450291_02-09-2025_18_42_41.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26450291_02-09-2025_18_42_41.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26450291','results_Auto_P26450291_02-09-2025_18_42_41.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26450291_02-09-2025_18_42_41.pdf','pdf','','0.53','0.10412554934916803') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26450291

https://www.fotonower.com/image?json=false&list_photos_id=1380867096
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380867094
La photo est trop floue, merci de reprendre une photo.(avec le score = 4.615818383742761)
https://www.fotonower.com/image?json=false&list_photos_id=1380867092
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380867050
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380867048
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380867013
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380867012
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.040943543147105)
https://www.fotonower.com/image?json=false&list_photos_id=1380866958
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866956
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866945
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.1207114421735898)
https://www.fotonower.com/image?json=false&list_photos_id=1380866943
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866938
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866903
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866899
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.122662963978461)
https://www.fotonower.com/image?json=false&list_photos_id=1380866897
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0316531687778308)
https://www.fotonower.com/image?json=false&list_photos_id=1380866884
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866882
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866880
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2046423844423932)
https://www.fotonower.com/image?json=false&list_photos_id=1380866854
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866852
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866836
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.0408568533768285)
https://www.fotonower.com/image?json=false&list_photos_id=1380866834
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380866831
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.41%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/26450475?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26450478?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26450482?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26450484?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26450485?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26450291_02-09-2025_18_42_41.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26450475,26450476,26450477,26450478,26450479,26450480,26450481,26450482,26450483,26450484,26450485?tags=metal,mal_croppe,background,carton,pehd,flou,environnement,papier,pet_fonce,pet_clair,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 02 Sep 2025 16:42:47 GMT Content-Length: 0 Connection: close X-Message-Id: WPQZasEIS0y0ac64IRnDHg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1380867096, 1380867094, 1380867092, 1380867050, 1380867048, 1380867013, 1380867012, 1380866958, 1380866956, 1380866945, 1380866943, 1380866938, 1380866903, 1380866899, 1380866897, 1380866884, 1380866882, 1380866880, 1380866854, 1380866852, 1380866836, 1380866834, 1380866831] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867096', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867094', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867092', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867050', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867048', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867013', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867012', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866958', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866956', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866945', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866943', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866938', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866903', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866899', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866897', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866884', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866882', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866880', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866854', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866852', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866836', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866834', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866831', None, None, None, None, None, '3653356') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.018449068069458008 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.382987022399902 time spend to save output : 0.018724441528320312 total time spend for step 9 : 5.401711463928223 step10:split_time_score Tue Sep 2 18:42:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 23),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02092025 26450291 Nombre de photos uploadées : 23 / 23040 (0%) 02092025 26450291 Nombre de photos taguées (types de déchets): 0 / 23 (0%) 02092025 26450291 Nombre de photos taguées (volume) : 0 / 23 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ??????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.000982046127319336 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21341586112976074 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.054770953896604954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26429659_02-09-2025_09_32_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26429659 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26429659 AND mptpi.`type`=3594 To do Qualite : 0.0918425188362382 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26435866_02-09-2025_12_12_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26435866 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26435866 AND mptpi.`type`=3594 To do Qualite : 0.13202340242704827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26435870_02-09-2025_12_02_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26435870 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26435870 AND mptpi.`type`=3594 To do Qualite : 0.21863142602237648 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26435873_02-09-2025_13_01_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26435873 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26435873 AND mptpi.`type`=3594 To do Qualite : 0.05131147457764782 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26444024_02-09-2025_16_52_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26444024 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26444024 AND mptpi.`type`=3594 To do Qualite : 0.07061470045194006 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26444026_02-09-2025_16_31_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26444026 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26444026 AND mptpi.`type`=3594 To do Qualite : 0.028957288451646086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26438219_02-09-2025_13_11_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26438219 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26438219 AND mptpi.`type`=3594 To do Qualite : 0.08259434624017961 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26440559_02-09-2025_14_41_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26440559 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26440559 AND mptpi.`type`=3594 To do Qualite : 0.1876932081228956 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26444032_02-09-2025_16_11_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26444032 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26444032 AND mptpi.`type`=3594 To do Qualite : 0.2689680989583333 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26444034_02-09-2025_16_22_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26444034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26444034 AND mptpi.`type`=3594 To do Qualite : 0.10412554934916803 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26450291_02-09-2025_18_42_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26450291 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26450291 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02092025': {'nb_upload': 23, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1380867096, 1380867094, 1380867092, 1380867050, 1380867048, 1380867013, 1380867012, 1380866958, 1380866956, 1380866945, 1380866943, 1380866938, 1380866903, 1380866899, 1380866897, 1380866884, 1380866882, 1380866880, 1380866854, 1380866852, 1380866836, 1380866834, 1380866831] Looping around the photos to save general results len do output : 1 /26450291Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867096', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867094', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867092', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867050', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867048', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867013', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380867012', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866958', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866956', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866945', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866943', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866938', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866903', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866899', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866897', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866884', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866882', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866880', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866854', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866852', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866836', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866834', None, None, None, None, None, '3653356') ('3318', None, None, None, None, None, None, None, '3653356') ('3318', '26450291', '1380866831', None, None, None, None, None, '3653356') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016254901885986328 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.9962191581726074 time spend to save output : 0.016556501388549805 total time spend for step 10 : 1.0127756595611572 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 23 set_done_treatment 81.68user 32.55system 2:23.78elapsed 79%CPU (0avgtext+0avgdata 2960592maxresident)k 643368inputs+42224outputs (8733major+2331851minor)pagefaults 0swaps