python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1684858 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3971868'] with mtr_portfolio_ids : ['28008504'] and first list_photo_ids : [] new path : /proc/1684858/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 2.5444889068603516 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 31 14:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-31 14:40:35.106421: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-31 14:40:35.130427: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-31 14:40:35.132562: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc8e0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-31 14:40:35.132612: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-31 14:40:35.136435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-31 14:40:35.280896: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x30a32700 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-31 14:40:35.280942: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-31 14:40:35.282482: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 14:40:35.282885: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:40:35.285832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:40:35.288570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 14:40:35.289063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 14:40:35.292123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 14:40:35.293137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 14:40:35.297115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 14:40:35.298626: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 14:40:35.298691: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:40:35.299458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 14:40:35.299473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 14:40:35.299482: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 14:40:35.300963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-31 14:40:35.569643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 14:40:35.569728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:40:35.569748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:40:35.569765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 14:40:35.569782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 14:40:35.569798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 14:40:35.569814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 14:40:35.569831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 14:40:35.571163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 14:40:35.572255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 14:40:35.572285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 14:40:35.572300: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:40:35.572314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 14:40:35.572328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 14:40:35.572341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 14:40:35.572355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 14:40:35.572368: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 14:40:35.573658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 14:40:35.573684: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 14:40:35.573693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 14:40:35.573700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 14:40:35.575050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-31 14:40:46.430124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 14:40:46.607523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 1685721 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008578300476074219 nb_pixel_total : 17431 time to create 1 rle with old method : 0.020473957061767578 length of segment : 148 time for calcul the mask position with numpy : 0.0007100105285644531 nb_pixel_total : 20608 time to create 1 rle with old method : 0.023551225662231445 length of segment : 183 time for calcul the mask position with numpy : 0.002228975296020508 nb_pixel_total : 66332 time to create 1 rle with old method : 0.07571196556091309 length of segment : 376 time for calcul the mask position with numpy : 0.004687786102294922 nb_pixel_total : 131264 time to create 1 rle with old method : 0.16161584854125977 length of segment : 430 time for calcul the mask position with numpy : 0.0026030540466308594 nb_pixel_total : 79504 time to create 1 rle with old method : 0.0960092544555664 length of segment : 404 time for calcul the mask position with numpy : 0.001165628433227539 nb_pixel_total : 30807 time to create 1 rle with old method : 0.04203367233276367 length of segment : 260 time for calcul the mask position with numpy : 0.008625268936157227 nb_pixel_total : 338601 time to create 1 rle with new method : 0.014532327651977539 length of segment : 748 time for calcul the mask position with numpy : 0.0013055801391601562 nb_pixel_total : 42155 time to create 1 rle with old method : 0.04872488975524902 length of segment : 220 time for calcul the mask position with numpy : 0.0005295276641845703 nb_pixel_total : 36845 time to create 1 rle with old method : 0.041674137115478516 length of segment : 262 time for calcul the mask position with numpy : 0.001775503158569336 nb_pixel_total : 131257 time to create 1 rle with old method : 0.17297649383544922 length of segment : 499 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 25797 time to create 1 rle with old method : 0.029514789581298828 length of segment : 272 time for calcul the mask position with numpy : 0.0002200603485107422 nb_pixel_total : 10667 time to create 1 rle with old method : 0.012666702270507812 length of segment : 130 time for calcul the mask position with numpy : 0.00019025802612304688 nb_pixel_total : 10247 time to create 1 rle with old method : 0.012198925018310547 length of segment : 94 time for calcul the mask position with numpy : 0.0017957687377929688 nb_pixel_total : 119010 time to create 1 rle with old method : 0.1408557891845703 length of segment : 352 time for calcul the mask position with numpy : 0.0004909038543701172 nb_pixel_total : 21947 time to create 1 rle with old method : 0.025467395782470703 length of segment : 156 time for calcul the mask position with numpy : 0.004422426223754883 nb_pixel_total : 266364 time to create 1 rle with new method : 0.016499757766723633 length of segment : 662 time for calcul the mask position with numpy : 0.0007123947143554688 nb_pixel_total : 50096 time to create 1 rle with old method : 0.05751371383666992 length of segment : 340 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 19818 time to create 1 rle with old method : 0.023152589797973633 length of segment : 214 time for calcul the mask position with numpy : 0.0015034675598144531 nb_pixel_total : 94501 time to create 1 rle with old method : 0.10763359069824219 length of segment : 350 time for calcul the mask position with numpy : 0.6623134613037109 nb_pixel_total : 424394 time to create 1 rle with new method : 0.03510117530822754 length of segment : 858 time for calcul the mask position with numpy : 0.004164934158325195 nb_pixel_total : 177251 time to create 1 rle with new method : 0.015370368957519531 length of segment : 858 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 23128 time to create 1 rle with old method : 0.0260770320892334 length of segment : 247 time for calcul the mask position with numpy : 0.0008554458618164062 nb_pixel_total : 45541 time to create 1 rle with old method : 0.05473208427429199 length of segment : 383 time for calcul the mask position with numpy : 0.0007472038269042969 nb_pixel_total : 34241 time to create 1 rle with old method : 0.03944683074951172 length of segment : 203 time for calcul the mask position with numpy : 0.0014128684997558594 nb_pixel_total : 40866 time to create 1 rle with old method : 0.047554731369018555 length of segment : 534 time for calcul the mask position with numpy : 0.0014841556549072266 nb_pixel_total : 58630 time to create 1 rle with old method : 0.06592845916748047 length of segment : 456 time for calcul the mask position with numpy : 0.0022673606872558594 nb_pixel_total : 134583 time to create 1 rle with old method : 0.167555570602417 length of segment : 484 time for calcul the mask position with numpy : 0.0008511543273925781 nb_pixel_total : 52506 time to create 1 rle with old method : 0.05934882164001465 length of segment : 329 time for calcul the mask position with numpy : 0.0005886554718017578 nb_pixel_total : 27106 time to create 1 rle with old method : 0.03150320053100586 length of segment : 138 time for calcul the mask position with numpy : 0.0004780292510986328 nb_pixel_total : 16804 time to create 1 rle with old method : 0.020878076553344727 length of segment : 200 time for calcul the mask position with numpy : 0.0003399848937988281 nb_pixel_total : 16014 time to create 1 rle with old method : 0.018735647201538086 length of segment : 217 time for calcul the mask position with numpy : 0.001444101333618164 nb_pixel_total : 72602 time to create 1 rle with old method : 0.08106040954589844 length of segment : 338 time for calcul the mask position with numpy : 0.0018846988677978516 nb_pixel_total : 81989 time to create 1 rle with old method : 0.09516072273254395 length of segment : 460 time for calcul the mask position with numpy : 0.0014011859893798828 nb_pixel_total : 50002 time to create 1 rle with old method : 0.05583333969116211 length of segment : 497 time for calcul the mask position with numpy : 0.00042438507080078125 nb_pixel_total : 10756 time to create 1 rle with old method : 0.01266026496887207 length of segment : 105 time for calcul the mask position with numpy : 0.0018558502197265625 nb_pixel_total : 56264 time to create 1 rle with old method : 0.06236624717712402 length of segment : 304 time for calcul the mask position with numpy : 0.0021750926971435547 nb_pixel_total : 61174 time to create 1 rle with old method : 0.07004237174987793 length of segment : 424 time for calcul the mask position with numpy : 0.0011105537414550781 nb_pixel_total : 31196 time to create 1 rle with old method : 0.03631162643432617 length of segment : 219 time for calcul the mask position with numpy : 0.0031566619873046875 nb_pixel_total : 69968 time to create 1 rle with old method : 0.08018994331359863 length of segment : 384 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 17852 time to create 1 rle with old method : 0.020788192749023438 length of segment : 191 time for calcul the mask position with numpy : 0.00208282470703125 nb_pixel_total : 56836 time to create 1 rle with old method : 0.06540846824645996 length of segment : 588 time for calcul the mask position with numpy : 0.0003294944763183594 nb_pixel_total : 7977 time to create 1 rle with old method : 0.009562969207763672 length of segment : 79 time for calcul the mask position with numpy : 0.0018334388732910156 nb_pixel_total : 59436 time to create 1 rle with old method : 0.07007479667663574 length of segment : 320 time for calcul the mask position with numpy : 0.0015561580657958984 nb_pixel_total : 39394 time to create 1 rle with old method : 0.04496502876281738 length of segment : 309 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 27438 time to create 1 rle with old method : 0.03272223472595215 length of segment : 226 time for calcul the mask position with numpy : 0.0005583763122558594 nb_pixel_total : 12368 time to create 1 rle with old method : 0.015044927597045898 length of segment : 123 time for calcul the mask position with numpy : 0.0056684017181396484 nb_pixel_total : 99250 time to create 1 rle with old method : 0.11574411392211914 length of segment : 389 time for calcul the mask position with numpy : 0.0008146762847900391 nb_pixel_total : 18112 time to create 1 rle with old method : 0.021456241607666016 length of segment : 151 time for calcul the mask position with numpy : 0.0007414817810058594 nb_pixel_total : 17564 time to create 1 rle with old method : 0.020694255828857422 length of segment : 199 time for calcul the mask position with numpy : 0.0006427764892578125 nb_pixel_total : 15326 time to create 1 rle with old method : 0.018347978591918945 length of segment : 146 time for calcul the mask position with numpy : 0.0034122467041015625 nb_pixel_total : 97534 time to create 1 rle with old method : 0.11064696311950684 length of segment : 408 time for calcul the mask position with numpy : 0.0005095005035400391 nb_pixel_total : 10535 time to create 1 rle with old method : 0.012165546417236328 length of segment : 107 time for calcul the mask position with numpy : 0.0022554397583007812 nb_pixel_total : 66308 time to create 1 rle with old method : 0.07483339309692383 length of segment : 395 time for calcul the mask position with numpy : 0.001590728759765625 nb_pixel_total : 61606 time to create 1 rle with old method : 0.06955957412719727 length of segment : 308 time for calcul the mask position with numpy : 0.0015087127685546875 nb_pixel_total : 51665 time to create 1 rle with old method : 0.05999755859375 length of segment : 344 time for calcul the mask position with numpy : 0.004668474197387695 nb_pixel_total : 195611 time to create 1 rle with new method : 0.009688138961791992 length of segment : 381 time for calcul the mask position with numpy : 0.0018699169158935547 nb_pixel_total : 69750 time to create 1 rle with old method : 0.07783126831054688 length of segment : 396 time for calcul the mask position with numpy : 0.0013077259063720703 nb_pixel_total : 44418 time to create 1 rle with old method : 0.05093717575073242 length of segment : 295 time for calcul the mask position with numpy : 0.00054931640625 nb_pixel_total : 11863 time to create 1 rle with old method : 0.013616323471069336 length of segment : 162 time for calcul the mask position with numpy : 0.005948543548583984 nb_pixel_total : 226911 time to create 1 rle with new method : 0.010010004043579102 length of segment : 379 time for calcul the mask position with numpy : 0.0002243518829345703 nb_pixel_total : 5233 time to create 1 rle with old method : 0.00607752799987793 length of segment : 82 time for calcul the mask position with numpy : 0.004145622253417969 nb_pixel_total : 123594 time to create 1 rle with old method : 0.13768267631530762 length of segment : 558 time for calcul the mask position with numpy : 0.001483917236328125 nb_pixel_total : 32861 time to create 1 rle with old method : 0.03728437423706055 length of segment : 295 time for calcul the mask position with numpy : 0.0013391971588134766 nb_pixel_total : 39676 time to create 1 rle with old method : 0.04621744155883789 length of segment : 431 time for calcul the mask position with numpy : 0.0007808208465576172 nb_pixel_total : 23531 time to create 1 rle with old method : 0.027057170867919922 length of segment : 226 time for calcul the mask position with numpy : 0.0014615058898925781 nb_pixel_total : 50488 time to create 1 rle with old method : 0.06011819839477539 length of segment : 395 time for calcul the mask position with numpy : 0.000743865966796875 nb_pixel_total : 28898 time to create 1 rle with old method : 0.03183269500732422 length of segment : 276 time for calcul the mask position with numpy : 0.0026731491088867188 nb_pixel_total : 139066 time to create 1 rle with old method : 0.15799188613891602 length of segment : 423 time for calcul the mask position with numpy : 0.0011589527130126953 nb_pixel_total : 43689 time to create 1 rle with old method : 0.04966259002685547 length of segment : 302 time for calcul the mask position with numpy : 0.0014812946319580078 nb_pixel_total : 75235 time to create 1 rle with old method : 0.08594059944152832 length of segment : 281 time for calcul the mask position with numpy : 0.0024385452270507812 nb_pixel_total : 114509 time to create 1 rle with old method : 0.12500309944152832 length of segment : 500 time for calcul the mask position with numpy : 0.0005617141723632812 nb_pixel_total : 21396 time to create 1 rle with old method : 0.024834632873535156 length of segment : 193 time for calcul the mask position with numpy : 0.0036487579345703125 nb_pixel_total : 151488 time to create 1 rle with new method : 0.009093046188354492 length of segment : 879 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 7362 time to create 1 rle with old method : 0.00841069221496582 length of segment : 73 time for calcul the mask position with numpy : 0.0006654262542724609 nb_pixel_total : 24722 time to create 1 rle with old method : 0.027467012405395508 length of segment : 216 time for calcul the mask position with numpy : 0.00044035911560058594 nb_pixel_total : 14550 time to create 1 rle with old method : 0.016886234283447266 length of segment : 131 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 11980 time to create 1 rle with old method : 0.014157533645629883 length of segment : 125 time for calcul the mask position with numpy : 0.0006413459777832031 nb_pixel_total : 23541 time to create 1 rle with old method : 0.03380298614501953 length of segment : 209 time for calcul the mask position with numpy : 0.0012314319610595703 nb_pixel_total : 38859 time to create 1 rle with old method : 0.05431675910949707 length of segment : 302 time for calcul the mask position with numpy : 0.0013213157653808594 nb_pixel_total : 52461 time to create 1 rle with old method : 0.061072349548339844 length of segment : 338 time for calcul the mask position with numpy : 0.0007965564727783203 nb_pixel_total : 25251 time to create 1 rle with old method : 0.030047178268432617 length of segment : 148 time for calcul the mask position with numpy : 0.0020465850830078125 nb_pixel_total : 71064 time to create 1 rle with old method : 0.08182239532470703 length of segment : 207 time for calcul the mask position with numpy : 0.0013957023620605469 nb_pixel_total : 52797 time to create 1 rle with old method : 0.05813169479370117 length of segment : 248 time for calcul the mask position with numpy : 0.0007526874542236328 nb_pixel_total : 22798 time to create 1 rle with old method : 0.025758028030395508 length of segment : 284 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 18146 time to create 1 rle with old method : 0.02008676528930664 length of segment : 287 time for calcul the mask position with numpy : 0.003045797348022461 nb_pixel_total : 19277 time to create 1 rle with old method : 0.021834135055541992 length of segment : 275 time for calcul the mask position with numpy : 0.0033528804779052734 nb_pixel_total : 71904 time to create 1 rle with old method : 0.0804593563079834 length of segment : 355 time for calcul the mask position with numpy : 0.0020706653594970703 nb_pixel_total : 46841 time to create 1 rle with old method : 0.05371832847595215 length of segment : 374 time for calcul the mask position with numpy : 0.004152536392211914 nb_pixel_total : 124781 time to create 1 rle with old method : 0.13988757133483887 length of segment : 457 time for calcul the mask position with numpy : 0.0006818771362304688 nb_pixel_total : 21000 time to create 1 rle with old method : 0.024567127227783203 length of segment : 132 time for calcul the mask position with numpy : 0.01090550422668457 nb_pixel_total : 262427 time to create 1 rle with new method : 0.02023911476135254 length of segment : 946 time for calcul the mask position with numpy : 0.0005469322204589844 nb_pixel_total : 25075 time to create 1 rle with old method : 0.02953505516052246 length of segment : 252 time for calcul the mask position with numpy : 0.0006225109100341797 nb_pixel_total : 29364 time to create 1 rle with old method : 0.03348255157470703 length of segment : 197 time for calcul the mask position with numpy : 0.0008258819580078125 nb_pixel_total : 19039 time to create 1 rle with old method : 0.02189779281616211 length of segment : 180 time spent for convertir_results : 10.279465198516846 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 94 chid ids of type : 3594 Number RLEs to save : 30211 save missing photos in datou_result : time spend for datou_step_exec : 62.4386785030365 time spend to save output : 1.6250531673431396 total time spend for step 1 : 64.06373167037964 step2:crop_condition Fri Oct 31 14:41:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 94 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 3736932 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918110_1684858 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074440_0.png', 0, 192, 140, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074441_0.png', 0, 172, 181, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074443_0.png', 0, 505, 422, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074445_0.png', 0, 157, 260, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074450_0.png', 0, 141, 272, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074451_0.png', 0, 134, 129, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074452_0.png', 0, 130, 94, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074454_0.png', 0, 239, 156, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074455_0.png', 0, 608, 638, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074457_0.png', 0, 137, 214, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074460_0.png', 0, 952, 372, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074461_0.png', 0, 147, 247, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074462_0.png', 0, 200, 324, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074463_0.png', 0, 215, 203, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074465_0.png', 0, 314, 318, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074468_0.png', 0, 249, 131, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074469_0.png', 0, 181, 183, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074470_0.png', 0, 152, 187, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074471_0.png', 0, 391, 304, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074476_0.png', 0, 325, 357, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074479_0.png', 0, 111, 190, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074480_0.png', 0, 354, 306, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074482_0.png', 0, 536, 173, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074483_0.png', 0, 196, 307, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074484_0.png', 0, 211, 225, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074485_0.png', 0, 151, 123, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074487_0.png', 0, 171, 151, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074488_0.png', 0, 119, 199, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074490_0.png', 0, 374, 408, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074491_0.png', 0, 153, 107, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074492_0.png', 0, 263, 395, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074496_0.png', 0, 219, 394, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074497_0.png', 0, 228, 295, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074500_0.png', 0, 78, 81, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074505_0.png', 0, 214, 387, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074511_0.png', 0, 181, 191, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074513_0.png', 0, 127, 73, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074515_0.png', 0, 170, 121, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074516_0.png', 0, 114, 125, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074517_0.png', 0, 143, 209, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074518_0.png', 0, 250, 235, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074519_0.png', 0, 325, 292, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074520_0.png', 0, 226, 146, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074522_0.png', 0, 305, 236, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074523_0.png', 0, 173, 207, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074524_0.png', 0, 95, 285, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074525_0.png', 0, 124, 269, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074526_0.png', 0, 472, 333, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074527_0.png', 0, 333, 294, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074528_0.png', 0, 590, 403, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074530_0.png', 0, 527, 930, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074531_0.png', 0, 180, 237, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074532_0.png', 0, 229, 193, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918121), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074533_0.png', 0, 205, 163, 0, 1761918121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 54 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.553168773651123 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918126_1684858 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074448_0.png', 0, 207, 224, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074474_0.png', 0, 144, 104, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074477_0.png', 0, 207, 218, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074498_0.png', 0, 139, 162, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074502_0.png', 0, 232, 295, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074504_0.png', 0, 172, 226, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074508_0.png', 0, 237, 276, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918128), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074514_0.png', 0, 176, 216, 0, 1761918128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.141775608062744 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918130_1684858 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918130), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074489_0.png', 0, 140, 146, 0, 1761918130,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5945758819580078 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918145_1684858 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074442_0.png', 0, 269, 376, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074444_0.png', 0, 253, 403, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074446_0.png', 0, 585, 717, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074449_0.png', 0, 469, 427, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074453_0.png', 0, 482, 328, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074456_0.png', 0, 179, 339, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074458_0.png', 0, 425, 335, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074459_0.png', 0, 720, 858, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074464_0.png', 0, 410, 270, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074466_0.png', 0, 372, 475, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074472_0.png', 0, 410, 400, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074473_0.png', 0, 238, 370, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074475_0.png', 0, 280, 304, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074478_0.png', 0, 417, 356, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074481_0.png', 0, 144, 77, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074486_0.png', 0, 500, 337, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074493_0.png', 0, 394, 308, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074494_0.png', 0, 205, 336, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074495_0.png', 0, 600, 376, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074499_0.png', 0, 693, 379, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074501_0.png', 0, 452, 552, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074503_0.png', 0, 183, 352, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074506_0.png', 0, 136, 276, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074507_0.png', 0, 494, 403, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074509_0.png', 0, 483, 206, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074510_0.png', 0, 282, 499, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074512_0.png', 0, 491, 502, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074521_0.png', 0, 450, 202, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918151), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074529_0.png', 0, 209, 127, 0, 1761918151,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.016156435012817 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918154_1684858 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918154), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074447_0.png', 0, 261, 214, 0, 1761918154,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5475025177001953 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761918156_1684858 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761918156), 0.0, 0.0, 14, '', 0, 0, '1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074467_0.png', 0, 214, 328, 0, 1761918156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6183836460113525 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390138241, 1390138235, 1390138222, 1390138220, 1390138219, 1390138218, 1390138217, 1390138215, 1390138207] Looping around the photos to save general results len do output : 94 /1391218922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391218999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391219029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138241', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138235', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138222', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138220', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138219', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138218', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138217', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138215', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138207', None, None, None, None, None, '3971868') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 291 time used for this insertion : 0.02327752113342285 save_final save missing photos in datou_result : time spend for datou_step_exec : 60.56810808181763 time spend to save output : 0.027135848999023438 total time spend for step 2 : 60.59524393081665 step3:rle_unique_nms_with_priority Fri Oct 31 14:42:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 94 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.792681932449341 time for calcul the mask position with numpy : 0.5855722427368164 nb_pixel_total : 7567698 time to create 1 rle with new method : 0.47069454193115234 time for calcul the mask position with numpy : 0.02866530418395996 nb_pixel_total : 42155 time to create 1 rle with old method : 0.04777812957763672 time for calcul the mask position with numpy : 0.02847433090209961 nb_pixel_total : 338601 time to create 1 rle with new method : 0.7131154537200928 time for calcul the mask position with numpy : 0.023997068405151367 nb_pixel_total : 30807 time to create 1 rle with old method : 0.03388237953186035 time for calcul the mask position with numpy : 0.026033639907836914 nb_pixel_total : 79504 time to create 1 rle with old method : 0.09266495704650879 time for calcul the mask position with numpy : 0.02550339698791504 nb_pixel_total : 131264 time to create 1 rle with old method : 0.14452362060546875 time for calcul the mask position with numpy : 0.02437567710876465 nb_pixel_total : 66332 time to create 1 rle with old method : 0.07148241996765137 time for calcul the mask position with numpy : 0.025893688201904297 nb_pixel_total : 20608 time to create 1 rle with old method : 0.023684024810791016 time for calcul the mask position with numpy : 0.029805660247802734 nb_pixel_total : 17431 time to create 1 rle with old method : 0.019364595413208008 create new chi : 2.484164237976074 time to delete rle : 0.017479419708251953 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 7698 TO DO : save crop sub photo not yet done ! save time : 0.45197296142578125 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.134432077407837 time for calcul the mask position with numpy : 0.3937215805053711 nb_pixel_total : 7087237 time to create 1 rle with new method : 0.9585189819335938 time for calcul the mask position with numpy : 0.029572486877441406 nb_pixel_total : 420614 time to create 1 rle with new method : 0.8327991962432861 time for calcul the mask position with numpy : 0.02695322036743164 nb_pixel_total : 94501 time to create 1 rle with old method : 0.131439208984375 time for calcul the mask position with numpy : 0.026248693466186523 nb_pixel_total : 19818 time to create 1 rle with old method : 0.022418737411499023 time for calcul the mask position with numpy : 0.02573704719543457 nb_pixel_total : 50096 time to create 1 rle with old method : 0.056528568267822266 time for calcul the mask position with numpy : 0.027576446533203125 nb_pixel_total : 266364 time to create 1 rle with new method : 0.661461353302002 time for calcul the mask position with numpy : 0.02470684051513672 nb_pixel_total : 21947 time to create 1 rle with old method : 0.02507925033569336 time for calcul the mask position with numpy : 0.02657175064086914 nb_pixel_total : 119010 time to create 1 rle with old method : 0.13991308212280273 time for calcul the mask position with numpy : 0.028167247772216797 nb_pixel_total : 10247 time to create 1 rle with old method : 0.011737585067749023 time for calcul the mask position with numpy : 0.027767419815063477 nb_pixel_total : 10667 time to create 1 rle with old method : 0.014124631881713867 time for calcul the mask position with numpy : 0.025493621826171875 nb_pixel_total : 25797 time to create 1 rle with old method : 0.02894282341003418 time for calcul the mask position with numpy : 0.026169538497924805 nb_pixel_total : 131257 time to create 1 rle with old method : 0.14570069313049316 time for calcul the mask position with numpy : 0.025772809982299805 nb_pixel_total : 36845 time to create 1 rle with old method : 0.04157376289367676 create new chi : 3.8812623023986816 time to delete rle : 0.0013971328735351562 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10282 TO DO : save crop sub photo not yet done ! save time : 0.5526731014251709 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.862040996551514 time for calcul the mask position with numpy : 0.586214542388916 nb_pixel_total : 7472656 time to create 1 rle with new method : 0.9776122570037842 time for calcul the mask position with numpy : 0.026134967803955078 nb_pixel_total : 50002 time to create 1 rle with old method : 0.057433366775512695 time for calcul the mask position with numpy : 0.02631855010986328 nb_pixel_total : 81989 time to create 1 rle with old method : 0.09013843536376953 time for calcul the mask position with numpy : 0.024460554122924805 nb_pixel_total : 72602 time to create 1 rle with old method : 0.0787818431854248 time for calcul the mask position with numpy : 0.024629831314086914 nb_pixel_total : 16014 time to create 1 rle with old method : 0.0173490047454834 time for calcul the mask position with numpy : 0.023349761962890625 nb_pixel_total : 16804 time to create 1 rle with old method : 0.018009662628173828 time for calcul the mask position with numpy : 0.0247037410736084 nb_pixel_total : 27106 time to create 1 rle with old method : 0.028568029403686523 time for calcul the mask position with numpy : 0.024888992309570312 nb_pixel_total : 52506 time to create 1 rle with old method : 0.057245731353759766 time for calcul the mask position with numpy : 0.026438474655151367 nb_pixel_total : 134583 time to create 1 rle with old method : 0.14704132080078125 time for calcul the mask position with numpy : 0.0256655216217041 nb_pixel_total : 58630 time to create 1 rle with old method : 0.06416177749633789 time for calcul the mask position with numpy : 0.02482008934020996 nb_pixel_total : 40866 time to create 1 rle with old method : 0.04416298866271973 time for calcul the mask position with numpy : 0.024689674377441406 nb_pixel_total : 34241 time to create 1 rle with old method : 0.03747820854187012 time for calcul the mask position with numpy : 0.023878097534179688 nb_pixel_total : 36022 time to create 1 rle with old method : 0.03909420967102051 time for calcul the mask position with numpy : 0.02340221405029297 nb_pixel_total : 23128 time to create 1 rle with old method : 0.024893760681152344 time for calcul the mask position with numpy : 0.02508068084716797 nb_pixel_total : 177251 time to create 1 rle with new method : 0.48688507080078125 create new chi : 3.1890041828155518 time to delete rle : 0.0018315315246582031 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 12594 TO DO : save crop sub photo not yet done ! save time : 0.6596393585205078 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.4566097259521484 time for calcul the mask position with numpy : 0.5558269023895264 nb_pixel_total : 7922941 time to create 1 rle with new method : 0.732940673828125 time for calcul the mask position with numpy : 0.024890422821044922 nb_pixel_total : 59436 time to create 1 rle with old method : 0.06891345977783203 time for calcul the mask position with numpy : 0.0242462158203125 nb_pixel_total : 7977 time to create 1 rle with old method : 0.008882761001586914 time for calcul the mask position with numpy : 0.02465653419494629 nb_pixel_total : 56836 time to create 1 rle with old method : 0.06397676467895508 time for calcul the mask position with numpy : 0.025555849075317383 nb_pixel_total : 17852 time to create 1 rle with old method : 0.019865036010742188 time for calcul the mask position with numpy : 0.02862238883972168 nb_pixel_total : 69968 time to create 1 rle with old method : 0.07847952842712402 time for calcul the mask position with numpy : 0.024637222290039062 nb_pixel_total : 31196 time to create 1 rle with old method : 0.03395557403564453 time for calcul the mask position with numpy : 0.025225400924682617 nb_pixel_total : 61174 time to create 1 rle with old method : 0.0676584243774414 time for calcul the mask position with numpy : 0.024013280868530273 nb_pixel_total : 56264 time to create 1 rle with old method : 0.06188774108886719 time for calcul the mask position with numpy : 0.02435159683227539 nb_pixel_total : 10756 time to create 1 rle with old method : 0.011674165725708008 create new chi : 1.9748938083648682 time to delete rle : 0.001012563705444336 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 7388 TO DO : save crop sub photo not yet done ! save time : 0.38672852516174316 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.028287172317505 time for calcul the mask position with numpy : 1.3103077411651611 nb_pixel_total : 7794535 time to create 1 rle with new method : 0.6615984439849854 time for calcul the mask position with numpy : 0.02425074577331543 nb_pixel_total : 51665 time to create 1 rle with old method : 0.056676626205444336 time for calcul the mask position with numpy : 0.023539066314697266 nb_pixel_total : 44371 time to create 1 rle with old method : 0.04849505424499512 time for calcul the mask position with numpy : 0.02445054054260254 nb_pixel_total : 66308 time to create 1 rle with old method : 0.07128357887268066 time for calcul the mask position with numpy : 0.024588584899902344 nb_pixel_total : 10535 time to create 1 rle with old method : 0.012456417083740234 time for calcul the mask position with numpy : 0.028517723083496094 nb_pixel_total : 97534 time to create 1 rle with old method : 0.12077975273132324 time for calcul the mask position with numpy : 0.023876428604125977 nb_pixel_total : 15326 time to create 1 rle with old method : 0.017125368118286133 time for calcul the mask position with numpy : 0.025076866149902344 nb_pixel_total : 17564 time to create 1 rle with old method : 0.019856691360473633 time for calcul the mask position with numpy : 0.02469491958618164 nb_pixel_total : 18112 time to create 1 rle with old method : 0.019396305084228516 time for calcul the mask position with numpy : 0.024990558624267578 nb_pixel_total : 99250 time to create 1 rle with old method : 0.1073615550994873 time for calcul the mask position with numpy : 0.023462533950805664 nb_pixel_total : 12368 time to create 1 rle with old method : 0.013437509536743164 time for calcul the mask position with numpy : 0.023296833038330078 nb_pixel_total : 27438 time to create 1 rle with old method : 0.030776500701904297 time for calcul the mask position with numpy : 0.024354934692382812 nb_pixel_total : 39394 time to create 1 rle with old method : 0.04128313064575195 create new chi : 2.8722801208496094 time to delete rle : 0.0011386871337890625 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8209 TO DO : save crop sub photo not yet done ! save time : 0.45918798446655273 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.3685011863708496 time for calcul the mask position with numpy : 0.4744875431060791 nb_pixel_total : 7520952 time to create 1 rle with new method : 0.9421122074127197 time for calcul the mask position with numpy : 0.023843050003051758 nb_pixel_total : 23531 time to create 1 rle with old method : 0.02572917938232422 time for calcul the mask position with numpy : 0.024136781692504883 nb_pixel_total : 39676 time to create 1 rle with old method : 0.04359316825866699 time for calcul the mask position with numpy : 0.025437593460083008 nb_pixel_total : 32861 time to create 1 rle with old method : 0.03650927543640137 time for calcul the mask position with numpy : 0.02660346031188965 nb_pixel_total : 123594 time to create 1 rle with old method : 0.13624787330627441 time for calcul the mask position with numpy : 0.02410125732421875 nb_pixel_total : 5233 time to create 1 rle with old method : 0.0057833194732666016 time for calcul the mask position with numpy : 0.0251467227935791 nb_pixel_total : 226911 time to create 1 rle with new method : 0.6281054019927979 time for calcul the mask position with numpy : 0.025093793869018555 nb_pixel_total : 11863 time to create 1 rle with old method : 0.01318216323852539 time for calcul the mask position with numpy : 0.023839473724365234 nb_pixel_total : 44418 time to create 1 rle with old method : 0.04752326011657715 time for calcul the mask position with numpy : 0.024817228317260742 nb_pixel_total : 69750 time to create 1 rle with old method : 0.07875180244445801 time for calcul the mask position with numpy : 0.029851675033569336 nb_pixel_total : 195611 time to create 1 rle with new method : 0.7852346897125244 create new chi : 3.5626323223114014 time to delete rle : 0.0012543201446533203 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8570 TO DO : save crop sub photo not yet done ! save time : 0.43699026107788086 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.444031000137329 time for calcul the mask position with numpy : 0.6743834018707275 nb_pixel_total : 7821119 time to create 1 rle with new method : 0.4604823589324951 time for calcul the mask position with numpy : 0.023789644241333008 nb_pixel_total : 21396 time to create 1 rle with old method : 0.02382493019104004 time for calcul the mask position with numpy : 0.027153730392456055 nb_pixel_total : 114509 time to create 1 rle with old method : 0.1450028419494629 time for calcul the mask position with numpy : 0.024396181106567383 nb_pixel_total : 75235 time to create 1 rle with old method : 0.08150124549865723 time for calcul the mask position with numpy : 0.02373194694519043 nb_pixel_total : 43689 time to create 1 rle with old method : 0.047524213790893555 time for calcul the mask position with numpy : 0.025490522384643555 nb_pixel_total : 139066 time to create 1 rle with old method : 0.15042805671691895 time for calcul the mask position with numpy : 0.024332523345947266 nb_pixel_total : 28898 time to create 1 rle with old method : 0.0317990779876709 time for calcul the mask position with numpy : 0.0250852108001709 nb_pixel_total : 50488 time to create 1 rle with old method : 0.0559542179107666 create new chi : 1.8877859115600586 time to delete rle : 0.0008938312530517578 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6900 TO DO : save crop sub photo not yet done ! save time : 0.37761569023132324 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 2.823852300643921 time for calcul the mask position with numpy : 0.502981424331665 nb_pixel_total : 7969437 time to create 1 rle with new method : 0.5601656436920166 time for calcul the mask position with numpy : 0.02367115020751953 nb_pixel_total : 52461 time to create 1 rle with old method : 0.05759787559509277 time for calcul the mask position with numpy : 0.039927005767822266 nb_pixel_total : 38859 time to create 1 rle with old method : 0.041635751724243164 time for calcul the mask position with numpy : 0.03999829292297363 nb_pixel_total : 23541 time to create 1 rle with old method : 0.03835940361022949 time for calcul the mask position with numpy : 0.04696393013000488 nb_pixel_total : 11980 time to create 1 rle with old method : 0.01420140266418457 time for calcul the mask position with numpy : 0.039263010025024414 nb_pixel_total : 14550 time to create 1 rle with old method : 0.016510009765625 time for calcul the mask position with numpy : 0.024523019790649414 nb_pixel_total : 24722 time to create 1 rle with old method : 0.02676534652709961 time for calcul the mask position with numpy : 0.024113178253173828 nb_pixel_total : 7362 time to create 1 rle with old method : 0.008036613464355469 time for calcul the mask position with numpy : 0.024664878845214844 nb_pixel_total : 151488 time to create 1 rle with new method : 0.5687527656555176 create new chi : 2.1680996417999268 time to delete rle : 0.000978708267211914 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6706 TO DO : save crop sub photo not yet done ! save time : 0.397294282913208 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 3.704991340637207 time for calcul the mask position with numpy : 0.44582414627075195 nb_pixel_total : 7485354 time to create 1 rle with new method : 0.9065659046173096 time for calcul the mask position with numpy : 0.02618575096130371 nb_pixel_total : 19039 time to create 1 rle with old method : 0.031719207763671875 time for calcul the mask position with numpy : 0.025616884231567383 nb_pixel_total : 29364 time to create 1 rle with old method : 0.03326129913330078 time for calcul the mask position with numpy : 0.024579286575317383 nb_pixel_total : 24357 time to create 1 rle with old method : 0.02751898765563965 time for calcul the mask position with numpy : 0.02570629119873047 nb_pixel_total : 262427 time to create 1 rle with new method : 0.23806548118591309 time for calcul the mask position with numpy : 0.024947404861450195 nb_pixel_total : 21000 time to create 1 rle with old method : 0.023949384689331055 time for calcul the mask position with numpy : 0.02814793586730957 nb_pixel_total : 124781 time to create 1 rle with old method : 0.13617444038391113 time for calcul the mask position with numpy : 0.025055408477783203 nb_pixel_total : 46841 time to create 1 rle with old method : 0.052640438079833984 time for calcul the mask position with numpy : 0.026437997817993164 nb_pixel_total : 71904 time to create 1 rle with old method : 0.07772040367126465 time for calcul the mask position with numpy : 0.024594783782958984 nb_pixel_total : 19277 time to create 1 rle with old method : 0.020943641662597656 time for calcul the mask position with numpy : 0.025417327880859375 nb_pixel_total : 18146 time to create 1 rle with old method : 0.019835472106933594 time for calcul the mask position with numpy : 0.02475905418395996 nb_pixel_total : 22798 time to create 1 rle with old method : 0.024822473526000977 time for calcul the mask position with numpy : 0.02518320083618164 nb_pixel_total : 52797 time to create 1 rle with old method : 0.05664372444152832 time for calcul the mask position with numpy : 0.02568817138671875 nb_pixel_total : 71064 time to create 1 rle with old method : 0.07974529266357422 time for calcul the mask position with numpy : 0.026238679885864258 nb_pixel_total : 25251 time to create 1 rle with old method : 0.0388031005859375 create new chi : 2.632314682006836 time to delete rle : 0.0021162033081054688 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10733 TO DO : save crop sub photo not yet done ! save time : 0.586071252822876 map_output_result : {1390138241: (0.0, 'Should be the crop_list due to order', 0), 1390138235: (0.0, 'Should be the crop_list due to order', 0), 1390138222: (0.0, 'Should be the crop_list due to order', 0), 1390138220: (0.0, 'Should be the crop_list due to order', 0), 1390138219: (0.0, 'Should be the crop_list due to order', 0), 1390138218: (0.0, 'Should be the crop_list due to order', 0), 1390138217: (0.0, 'Should be the crop_list due to order', 0), 1390138215: (0.0, 'Should be the crop_list due to order', 0), 1390138207: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390138241, 1390138235, 1390138222, 1390138220, 1390138219, 1390138218, 1390138217, 1390138215, 1390138207] Looping around the photos to save general results len do output : 9 /1390138241.Didn't retrieve data . /1390138235.Didn't retrieve data . /1390138222.Didn't retrieve data . /1390138220.Didn't retrieve data . /1390138219.Didn't retrieve data . /1390138218.Didn't retrieve data . /1390138217.Didn't retrieve data . /1390138215.Didn't retrieve data . /1390138207.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138241', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138235', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138222', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138220', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138219', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138218', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138217', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138215', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138207', None, None, None, None, None, '3971868') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.011206626892089844 save_final save missing photos in datou_result : time spend for datou_step_exec : 63.088951587677 time spend to save output : 0.011573076248168945 total time spend for step 3 : 63.10052466392517 step4:ventilate_hashtags_in_portfolio Fri Oct 31 14:43:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28008504 get user id for portfolio 28008504 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008504 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','pehd','flou','autre','pet_clair','environnement','carton','background','metal','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008504 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','pehd','flou','autre','pet_clair','environnement','carton','background','metal','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008504 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','pehd','flou','autre','pet_clair','environnement','carton','background','metal','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28026692,28026693,28026694,28026695,28026697,28026698,28026699,28026700,28026702,28026703,28026704?tags=mal_croppe,pet_fonce,pehd,flou,autre,pet_clair,environnement,carton,background,metal,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390138241, 1390138235, 1390138222, 1390138220, 1390138219, 1390138218, 1390138217, 1390138215, 1390138207] Looping around the photos to save general results len do output : 1 /28008504. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138241', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138235', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138222', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138220', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138219', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138218', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138217', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138215', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138207', None, None, None, None, None, '3971868') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.011590719223022461 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.809436321258545 time spend to save output : 0.011845827102661133 total time spend for step 4 : 1.821282148361206 step5:final Fri Oct 31 14:43:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390138241: ('0.08047827449845683',), 1390138235: ('0.08047827449845683',), 1390138222: ('0.08047827449845683',), 1390138220: ('0.08047827449845683',), 1390138219: ('0.08047827449845683',), 1390138218: ('0.08047827449845683',), 1390138217: ('0.08047827449845683',), 1390138215: ('0.08047827449845683',), 1390138207: ('0.08047827449845683',)} new output for save of step final : {1390138241: ('0.08047827449845683',), 1390138235: ('0.08047827449845683',), 1390138222: ('0.08047827449845683',), 1390138220: ('0.08047827449845683',), 1390138219: ('0.08047827449845683',), 1390138218: ('0.08047827449845683',), 1390138217: ('0.08047827449845683',), 1390138215: ('0.08047827449845683',), 1390138207: ('0.08047827449845683',)} [1390138241, 1390138235, 1390138222, 1390138220, 1390138219, 1390138218, 1390138217, 1390138215, 1390138207] Looping around the photos to save general results len do output : 9 /1390138241.Didn't retrieve data . /1390138235.Didn't retrieve data . /1390138222.Didn't retrieve data . /1390138220.Didn't retrieve data . /1390138219.Didn't retrieve data . /1390138218.Didn't retrieve data . /1390138217.Didn't retrieve data . /1390138215.Didn't retrieve data . /1390138207.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138241', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138235', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138222', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138220', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138219', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138218', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138217', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138215', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138207', None, None, None, None, None, '3971868') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.010880708694458008 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13167905807495117 time spend to save output : 0.01138448715209961 total time spend for step 5 : 0.14306354522705078 step6:blur_detection Fri Oct 31 14:43:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164.jpg resize: (2160, 3840) 1390138241 -6.7277594973325705 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148.jpg resize: (2160, 3840) 1390138235 -6.8570937708087465 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043.jpg resize: (2160, 3840) 1390138222 -6.846319841603729 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949.jpg resize: (2160, 3840) 1390138220 -6.950969787305874 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073.jpg resize: (2160, 3840) 1390138219 -6.813571986356845 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329.jpg resize: (2160, 3840) 1390138218 -6.903072912909074 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757.jpg resize: (2160, 3840) 1390138217 -6.8048625687001865 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530.jpg resize: (2160, 3840) 1390138215 -6.895286761487613 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376.jpg resize: (2160, 3840) 1390138207 -6.985748110153754 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074440_0.png resize: (140, 192) 1391218922 -3.844492735954773 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074441_0.png resize: (181, 172) 1391218923 -2.3208976357865714 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074443_0.png resize: (422, 505) 1391218924 -1.8411210807982141 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074445_0.png resize: (260, 157) 1391218925 -2.0176105342109434 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074450_0.png resize: (272, 141) 1391218926 -4.517286141906012 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074451_0.png resize: (129, 134) 1391218927 -3.931448781321896 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074452_0.png resize: (94, 130) 1391218928 3.06425550448592 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074454_0.png resize: (156, 239) 1391218929 1.3751220678290244 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074455_0.png resize: (638, 608) 1391218930 -4.534588143182699 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074457_0.png resize: (214, 137) 1391218931 -2.9729415302741047 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074460_0.png resize: (372, 952) 1391218932 -3.822632668372485 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074461_0.png resize: (247, 147) 1391218933 -1.0324614463409219 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074462_0.png resize: (324, 200) 1391218935 -1.9420458557851992 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074463_0.png resize: (203, 215) 1391218936 1.113069230563107 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074465_0.png resize: (318, 314) 1391218937 -1.0159485499286074 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074468_0.png resize: (131, 249) 1391218938 -3.012501698095859 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074469_0.png resize: (183, 181) 1391218939 -4.561143561713769 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074470_0.png resize: (187, 152) 1391218940 -1.3459694553894186 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074471_0.png resize: (304, 391) 1391218941 -1.330944654042028 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074476_0.png resize: (357, 325) 1391218942 -3.1042335756023864 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074479_0.png resize: (190, 111) 1391218943 -3.258424790410711 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074480_0.png resize: (306, 354) 1391218944 -0.054424806368619676 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074482_0.png resize: (173, 536) 1391218945 -4.696068391367909 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074483_0.png resize: (307, 196) 1391218946 1.8582764400953113 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074484_0.png resize: (225, 211) 1391218947 -4.228885899708247 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074485_0.png resize: (123, 151) 1391218948 -2.994033156626291 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074487_0.png resize: (151, 171) 1391218949 -3.849461898997587 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074488_0.png resize: (199, 119) 1391218950 -3.6553532653742336 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074490_0.png resize: (408, 374) 1391218951 -4.970428104741582 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074491_0.png resize: (107, 153) 1391218952 -0.6288192063190147 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074492_0.png resize: (395, 263) 1391218953 -4.544742550537777 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074496_0.png resize: (394, 219) 1391218954 -0.8489813870661229 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074497_0.png resize: (295, 228) 1391218955 -2.550350657855291 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074500_0.png resize: (81, 78) 1391218956 -4.210284442193299 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074505_0.png resize: (387, 214) 1391218957 -2.2942131236691847 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074511_0.png resize: (191, 181) 1391218958 -3.440407835366172 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074513_0.png resize: (73, 127) 1391218959 -2.7549886064620517 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074515_0.png resize: (121, 170) 1391218960 -2.0050054782740454 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074516_0.png resize: (125, 114) 1391218961 -2.226749223312061 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074517_0.png resize: (209, 143) 1391218962 -4.098260858293437 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074518_0.png resize: (235, 250) 1391218963 -2.898654758252476 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074519_0.png resize: (292, 325) 1391218964 -4.19923301778134 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074520_0.png resize: (146, 226) 1391218965 -3.610003165574971 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074522_0.png resize: (236, 305) 1391218966 -1.446080912566786 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074523_0.png resize: (207, 173) 1391218967 -4.096678592235258 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074524_0.png resize: (285, 95) 1391218968 -3.6147537679975086 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074525_0.png resize: (269, 124) 1391218969 -3.3052283775142706 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074526_0.png resize: (333, 472) 1391218970 -4.156530970874875 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074527_0.png resize: (294, 333) 1391218971 -4.2777039092689835 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074528_0.png resize: (403, 590) 1391218972 -2.9683478632951723 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074530_0.png resize: (930, 527) 1391218973 -2.7024123074970676 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074531_0.png resize: (237, 180) 1391218974 -4.358501356351568 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074532_0.png resize: (193, 229) 1391218975 -4.21238493511118 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074533_0.png resize: (163, 205) 1391218976 -3.690363905149191 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074448_0.png resize: (224, 207) 1391218979 -4.820607962561726 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074474_0.png resize: (104, 144) 1391218980 -2.9617648536545684 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074477_0.png resize: (218, 207) 1391218981 -4.321897657562126 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074498_0.png resize: (162, 139) 1391218982 -2.646444001472152 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074502_0.png resize: (295, 232) 1391218983 -4.071867248789656 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074504_0.png resize: (226, 172) 1391218984 0.7919894625888585 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074508_0.png resize: (276, 237) 1391218985 -3.4533051138113287 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074514_0.png resize: (216, 176) 1391218986 -2.5476285810372437 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074489_0.png resize: (146, 140) 1391218988 -5.035069371902054 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074442_0.png resize: (376, 269) 1391218996 -3.962513988039999 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074444_0.png resize: (403, 253) 1391218997 -4.247280716433741 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074446_0.png resize: (717, 585) 1391218998 -5.01949913271066 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074449_0.png resize: (427, 469) 1391218999 -3.8084143476225463 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074453_0.png resize: (328, 482) 1391219000 -4.262319472523702 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074456_0.png resize: (339, 179) 1391219001 -4.87885667200352 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074458_0.png resize: (335, 425) 1391219002 -4.714494574197291 treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074459_0.png resize: (858, 720) 1391219003 -5.165928319373912 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074464_0.png resize: (270, 410) 1391219004 -2.801842384190827 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074466_0.png resize: (475, 372) 1391219005 -5.394882706090433 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074472_0.png resize: (400, 410) 1391219006 -4.001861861849128 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074473_0.png resize: (370, 238) 1391219007 -3.839819569596166 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074475_0.png resize: (304, 280) 1391219008 -5.101045315695598 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074478_0.png resize: (356, 417) 1391219009 -4.0727320702588745 treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074481_0.png resize: (77, 144) 1391219010 -0.7254630071586867 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074486_0.png resize: (337, 500) 1391219011 -4.04564498760434 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074493_0.png resize: (308, 394) 1391219012 -3.489008866912586 treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074494_0.png resize: (336, 205) 1391219013 -3.258105197989467 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074495_0.png resize: (376, 600) 1391219014 -5.187274743090611 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074499_0.png resize: (379, 693) 1391219015 -5.428180802683577 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074501_0.png resize: (552, 452) 1391219016 -4.944721649948341 treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074503_0.png resize: (352, 183) 1391219017 -3.979667900445282 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074506_0.png resize: (276, 136) 1391219018 -4.798807763438935 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074507_0.png resize: (403, 494) 1391219019 -4.616102579611646 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074509_0.png resize: (206, 483) 1391219020 -2.6904701164241454 treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074510_0.png resize: (499, 282) 1391219021 -5.608776496632145 treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074512_0.png resize: (502, 491) 1391219022 -5.405710035025495 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074521_0.png resize: (202, 450) 1391219023 -4.214839152474634 treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074529_0.png resize: (127, 209) 1391219024 -4.162862941352086 treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074447_0.png resize: (214, 261) 1391219028 -4.936665860969961 treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074467_0.png resize: (328, 214) 1391219029 -4.201463681440871 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.013853073120117188 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.024616718292236328 save missing photos in datou_result : time spend for datou_step_exec : 33.2648344039917 time spend to save output : 0.044966697692871094 total time spend for step 6 : 33.30980110168457 step7:brightness Fri Oct 31 14:44:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164.jpg treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148.jpg treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043.jpg treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949.jpg treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073.jpg treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329.jpg treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757.jpg treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530.jpg treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376.jpg treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074440_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074441_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074443_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074445_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074450_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074451_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074452_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074454_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074455_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074457_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074460_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074461_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074462_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074463_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074465_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074468_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074469_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074470_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074471_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074476_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074479_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074480_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074482_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074483_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074484_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074485_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074487_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074488_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074490_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074491_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074492_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074496_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074497_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074500_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074505_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074511_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074513_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074515_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074516_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074517_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074518_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074519_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074520_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074522_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074523_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074524_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074525_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074526_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074527_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074528_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074530_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074531_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074532_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074533_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074448_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074474_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074477_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074498_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074502_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074504_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074508_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074514_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074489_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074442_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074444_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074446_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074449_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074453_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074456_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074458_0.png treat image : temp/1761918029_1684858_1390138235_0c80cd8ab2a79036f39d23cd5726a250_30960148_rle_crop_4010074459_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074464_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074466_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074472_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074473_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074475_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074478_0.png treat image : temp/1761918029_1684858_1390138220_69bb8eaa9d67fa1fc684cf2aecdb053b_23103949_rle_crop_4010074481_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074486_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074493_0.png treat image : temp/1761918029_1684858_1390138219_f4cc16e858963d6e6cf1ad894c542a88_2106073_rle_crop_4010074494_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074495_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074499_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074501_0.png treat image : temp/1761918029_1684858_1390138218_5c690352c62411024abc87db24987454_39800329_rle_crop_4010074503_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074506_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074507_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074509_0.png treat image : temp/1761918029_1684858_1390138217_402c848105a3eba55d57aae594dc7675_48536757_rle_crop_4010074510_0.png treat image : temp/1761918029_1684858_1390138215_6b54869a0958bcafe378004b04c9b8a8_56466530_rle_crop_4010074512_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074521_0.png treat image : temp/1761918029_1684858_1390138207_89197db90802c3f44f89d90c418f143e_70825376_rle_crop_4010074529_0.png treat image : temp/1761918029_1684858_1390138241_3d95775a2e7b0348bd33731c0fddcd66_53773164_rle_crop_4010074447_0.png treat image : temp/1761918029_1684858_1390138222_40afb81dfcb3dee667622186b9c2a6ff_86107043_rle_crop_4010074467_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.013600349426269531 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.023728609085083008 save missing photos in datou_result : time spend for datou_step_exec : 8.843644380569458 time spend to save output : 0.04237532615661621 total time spend for step 7 : 8.886019706726074 step8:velours_tree Fri Oct 31 14:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.20949769020080566 time spend to save output : 4.291534423828125e-05 total time spend for step 8 : 0.20954060554504395 step9:send_mail_cod Fri Oct 31 14:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28008504_31-10-2025_14_44_24.pdf 28026692 imagette280266921761918264 28026693 change filename to text .imagette280266931761918264 28026694 imagette280266941761918264 28026695 imagette280266951761918264 28026697 change filename to text .imagette280266971761918264 28026698 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280266981761918264 28026700 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280267001761918266 28026702 imagette280267021761918267 28026703 change filename to text .imagette280267031761918267 28026704 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280267041761918267 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28008504 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28026692,28026693,28026694,28026695,28026697,28026698,28026699,28026700,28026702,28026703,28026704?tags=mal_croppe,pet_fonce,pehd,flou,autre,pet_clair,environnement,carton,background,metal,papier args[1390138241] : ((1390138241, -6.7277594973325705, 492609224), (1390138241, 0.7715590821736358, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138235] : ((1390138235, -6.8570937708087465, 492609224), (1390138235, 0.8423665079502762, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138222] : ((1390138222, -6.846319841603729, 492609224), (1390138222, 0.9302363522747386, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138220] : ((1390138220, -6.950969787305874, 492609224), (1390138220, 0.9234670501384691, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138219] : ((1390138219, -6.813571986356845, 492609224), (1390138219, 0.7976731580786676, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138218] : ((1390138218, -6.903072912909074, 492609224), (1390138218, 0.8766052248426849, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138217] : ((1390138217, -6.8048625687001865, 492609224), (1390138217, 0.9037871961118229, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138215] : ((1390138215, -6.895286761487613, 492609224), (1390138215, 0.8899241378415651, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com args[1390138207] : ((1390138207, -6.985748110153754, 492609224), (1390138207, 1.016396019849118, 2107752395), '0.08047827449845683') We are sending mail with results at report@fotonower.com refus_total : 0.08047827449845683 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28008504 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008504_31-10-2025_14_44_24.pdf results_Auto_P28008504_31-10-2025_14_44_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008504_31-10-2025_14_44_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28008504','results_Auto_P28008504_31-10-2025_14_44_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008504_31-10-2025_14_44_24.pdf','pdf','','0.64','0.08047827449845683') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28008504

https://www.fotonower.com/image?json=false&list_photos_id=1390138241
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138235
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138222
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138220
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138219
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138218
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138217
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138215
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390138207
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.05%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28026693?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28026697?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28026698?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28026700?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28026703?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28026704?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008504_31-10-2025_14_44_24.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28026692,28026693,28026694,28026695,28026697,28026698,28026699,28026700,28026702,28026703,28026704?tags=mal_croppe,pet_fonce,pehd,flou,autre,pet_clair,environnement,carton,background,metal,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 31 Oct 2025 13:44:32 GMT Content-Length: 0 Connection: close X-Message-Id: DdJdR5XXQF6Mwm_HgF1A1w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390138241, 1390138235, 1390138222, 1390138220, 1390138219, 1390138218, 1390138217, 1390138215, 1390138207] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138241', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138235', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138222', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138220', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138219', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138218', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138217', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138215', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138207', None, None, None, None, None, '3971868') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.010337352752685547 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.655684471130371 time spend to save output : 0.010613441467285156 total time spend for step 9 : 7.666297912597656 step10:split_time_score Fri Oct 31 14:44:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23102025 28008504 Nombre de photos uploadées : 9 / 23040 (0%) 23102025 28008504 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 23102025 28008504 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005218982696533203 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2142622470855713 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008154 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008200 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008290 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008334 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008473 order by id desc limit 1 Qualite : 0.08047827449845683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008504_31-10-2025_14_44_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008504 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008504 AND mptpi.`type`=3594 To do Qualite : 0.015526504498986078 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008512_31-10-2025_09_23_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008512 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008512 AND mptpi.`type`=3726 To do Qualite : 0.017347448653557977 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008634_31-10-2025_09_07_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008634 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008634 AND mptpi.`type`=3726 To do Qualite : 0.028557345527743153 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008640_31-10-2025_09_18_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008640 AND mptpi.`type`=3726 To do Qualite : 0.03534976501122333 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008658_31-10-2025_09_24_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008658 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008658 AND mptpi.`type`=3594 To do Qualite : 0.03207469661896745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008685_31-10-2025_09_14_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008685 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008685 AND mptpi.`type`=3594 To do Qualite : 0.08704102049769485 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28008705_31-10-2025_09_12_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28008705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28008705 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23102025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390138241, 1390138235, 1390138222, 1390138220, 1390138219, 1390138218, 1390138217, 1390138215, 1390138207] Looping around the photos to save general results len do output : 1 /28008504Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138241', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138235', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138222', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138220', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138219', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138218', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138217', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138215', None, None, None, None, None, '3971868') ('3318', None, None, None, None, None, None, None, '3971868') ('3318', '28008504', '1390138207', None, None, None, None, None, '3971868') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.011818885803222656 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.12039828300476 time spend to save output : 0.012049198150634766 total time spend for step 10 : 10.132447481155396 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 121.53user 88.58system 4:16.26elapsed 81%CPU (0avgtext+0avgdata 4522932maxresident)k 551632inputs+117560outputs (5796major+10158124minor)pagefaults 0swaps