python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2219034 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4022882'] with mtr_portfolio_ids : ['28354585'] and first list_photo_ids : [] new path : /proc/2219034/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 2.542343854904175 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Nov 8 14:40:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-08 14:40:32.309631: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-08 14:40:32.334566: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-08 14:40:32.336563: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7b38000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-08 14:40:32.336610: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-08 14:40:32.340051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-08 14:40:32.639644: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2df4f700 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-08 14:40:32.639698: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-08 14:40:32.641040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-08 14:40:32.641394: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 14:40:32.644288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 14:40:32.646822: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-08 14:40:32.647286: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-08 14:40:32.650391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-08 14:40:32.651587: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-08 14:40:32.655181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 14:40:32.656503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-08 14:40:32.656554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 14:40:32.657257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-08 14:40:32.657270: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-08 14:40:32.657278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-08 14:40:32.658569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-08 14:40:32.897618: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-08 14:40:32.897703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 14:40:32.897725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 14:40:32.897745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-08 14:40:32.897764: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-08 14:40:32.897783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-08 14:40:32.897802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-08 14:40:32.897821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 14:40:32.899506: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-08 14:40:32.901137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-08 14:40:32.901214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-08 14:40:32.901235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 14:40:32.901253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-08 14:40:32.901270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-08 14:40:32.901287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-08 14:40:32.901305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-08 14:40:32.901323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-08 14:40:32.903058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-08 14:40:32.903110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-08 14:40:32.903123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-08 14:40:32.903133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-08 14:40:32.904607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-08 14:40:39.957811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-08 14:40:40.146572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 Detection mask done ! Trying to reset tf kernel 2219714 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4907 tf kernel not reseted sub process len(results) : 18 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 18 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10196 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 6777 time to create 1 rle with old method : 0.0077610015869140625 length of segment : 76 time for calcul the mask position with numpy : 0.0003490447998046875 nb_pixel_total : 11301 time to create 1 rle with old method : 0.012935876846313477 length of segment : 146 time for calcul the mask position with numpy : 0.00021004676818847656 nb_pixel_total : 13371 time to create 1 rle with old method : 0.015155792236328125 length of segment : 103 time for calcul the mask position with numpy : 0.00011730194091796875 nb_pixel_total : 5683 time to create 1 rle with old method : 0.006515979766845703 length of segment : 93 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 5999 time to create 1 rle with old method : 0.00652313232421875 length of segment : 166 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 7872 time to create 1 rle with old method : 0.008723974227905273 length of segment : 183 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 3343 time to create 1 rle with old method : 0.0038831233978271484 length of segment : 113 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 4543 time to create 1 rle with old method : 0.005431652069091797 length of segment : 111 time for calcul the mask position with numpy : 0.002804994583129883 nb_pixel_total : 192963 time to create 1 rle with new method : 0.005193948745727539 length of segment : 354 time for calcul the mask position with numpy : 0.0001380443572998047 nb_pixel_total : 4402 time to create 1 rle with old method : 0.005283832550048828 length of segment : 97 time for calcul the mask position with numpy : 8.940696716308594e-05 nb_pixel_total : 3513 time to create 1 rle with old method : 0.0041501522064208984 length of segment : 71 time for calcul the mask position with numpy : 0.00016069412231445312 nb_pixel_total : 6363 time to create 1 rle with old method : 0.007130622863769531 length of segment : 178 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 6072 time to create 1 rle with old method : 0.0068972110748291016 length of segment : 100 time for calcul the mask position with numpy : 0.0004897117614746094 nb_pixel_total : 32674 time to create 1 rle with old method : 0.035451412200927734 length of segment : 297 time for calcul the mask position with numpy : 0.00027871131896972656 nb_pixel_total : 17936 time to create 1 rle with old method : 0.018643856048583984 length of segment : 156 time for calcul the mask position with numpy : 0.0001933574676513672 nb_pixel_total : 12369 time to create 1 rle with old method : 0.013188600540161133 length of segment : 121 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 42573 time to create 1 rle with old method : 0.04584646224975586 length of segment : 185 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 2398 time to create 1 rle with old method : 0.002824544906616211 length of segment : 58 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 40126 time to create 1 rle with old method : 0.04310011863708496 length of segment : 319 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 9596 time to create 1 rle with old method : 0.010357141494750977 length of segment : 182 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 12684 time to create 1 rle with old method : 0.013817071914672852 length of segment : 145 time for calcul the mask position with numpy : 0.001207590103149414 nb_pixel_total : 86803 time to create 1 rle with old method : 0.09099984169006348 length of segment : 518 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 21632 time to create 1 rle with old method : 0.023782014846801758 length of segment : 187 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 10009 time to create 1 rle with old method : 0.011153459548950195 length of segment : 112 time for calcul the mask position with numpy : 0.001470327377319336 nb_pixel_total : 103895 time to create 1 rle with old method : 0.1161184310913086 length of segment : 574 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 1936 time to create 1 rle with old method : 0.002376556396484375 length of segment : 55 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 9727 time to create 1 rle with old method : 0.011075973510742188 length of segment : 105 time for calcul the mask position with numpy : 0.0002593994140625 nb_pixel_total : 11574 time to create 1 rle with old method : 0.013338327407836914 length of segment : 59 time for calcul the mask position with numpy : 0.0002429485321044922 nb_pixel_total : 3888 time to create 1 rle with old method : 0.004229068756103516 length of segment : 131 time for calcul the mask position with numpy : 0.00014448165893554688 nb_pixel_total : 5770 time to create 1 rle with old method : 0.006556034088134766 length of segment : 73 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 21975 time to create 1 rle with old method : 0.023946523666381836 length of segment : 127 time for calcul the mask position with numpy : 0.0004105567932128906 nb_pixel_total : 9978 time to create 1 rle with old method : 0.01059722900390625 length of segment : 112 time for calcul the mask position with numpy : 0.00021719932556152344 nb_pixel_total : 3362 time to create 1 rle with old method : 0.003930568695068359 length of segment : 133 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 2392 time to create 1 rle with old method : 0.002900838851928711 length of segment : 41 time for calcul the mask position with numpy : 0.0006966590881347656 nb_pixel_total : 21197 time to create 1 rle with old method : 0.02344536781311035 length of segment : 242 time for calcul the mask position with numpy : 0.00034499168395996094 nb_pixel_total : 5955 time to create 1 rle with old method : 0.006571769714355469 length of segment : 160 time for calcul the mask position with numpy : 0.0001857280731201172 nb_pixel_total : 4919 time to create 1 rle with old method : 0.0055332183837890625 length of segment : 93 time for calcul the mask position with numpy : 0.0009512901306152344 nb_pixel_total : 32328 time to create 1 rle with old method : 0.034012556076049805 length of segment : 239 time for calcul the mask position with numpy : 0.00034499168395996094 nb_pixel_total : 9379 time to create 1 rle with old method : 0.010358572006225586 length of segment : 163 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 3704 time to create 1 rle with old method : 0.004522800445556641 length of segment : 46 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 12670 time to create 1 rle with old method : 0.014243841171264648 length of segment : 133 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 3817 time to create 1 rle with old method : 0.006678104400634766 length of segment : 59 time for calcul the mask position with numpy : 0.0003249645233154297 nb_pixel_total : 7633 time to create 1 rle with old method : 0.013097286224365234 length of segment : 102 time for calcul the mask position with numpy : 0.0004267692565917969 nb_pixel_total : 11069 time to create 1 rle with old method : 0.013312816619873047 length of segment : 119 time for calcul the mask position with numpy : 0.00023865699768066406 nb_pixel_total : 7114 time to create 1 rle with old method : 0.008413553237915039 length of segment : 83 time for calcul the mask position with numpy : 0.00021576881408691406 nb_pixel_total : 3441 time to create 1 rle with old method : 0.004012584686279297 length of segment : 121 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 6911 time to create 1 rle with old method : 0.008424043655395508 length of segment : 77 time for calcul the mask position with numpy : 0.0002570152282714844 nb_pixel_total : 6291 time to create 1 rle with old method : 0.0073621273040771484 length of segment : 118 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 3259 time to create 1 rle with old method : 0.0039942264556884766 length of segment : 65 time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 3293 time to create 1 rle with old method : 0.004649162292480469 length of segment : 129 time for calcul the mask position with numpy : 0.00067138671875 nb_pixel_total : 21347 time to create 1 rle with old method : 0.03462696075439453 length of segment : 229 time for calcul the mask position with numpy : 0.0003006458282470703 nb_pixel_total : 14535 time to create 1 rle with old method : 0.02133321762084961 length of segment : 210 time for calcul the mask position with numpy : 0.00045037269592285156 nb_pixel_total : 12696 time to create 1 rle with old method : 0.021053314208984375 length of segment : 104 time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 21271 time to create 1 rle with old method : 0.02436089515686035 length of segment : 167 time for calcul the mask position with numpy : 0.0005114078521728516 nb_pixel_total : 18163 time to create 1 rle with old method : 0.020905494689941406 length of segment : 121 time for calcul the mask position with numpy : 0.0001533031463623047 nb_pixel_total : 6439 time to create 1 rle with old method : 0.0076885223388671875 length of segment : 124 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 7384 time to create 1 rle with old method : 0.008891582489013672 length of segment : 87 time for calcul the mask position with numpy : 0.0010809898376464844 nb_pixel_total : 71280 time to create 1 rle with old method : 0.08629012107849121 length of segment : 551 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 7782 time to create 1 rle with old method : 0.008683204650878906 length of segment : 99 time for calcul the mask position with numpy : 0.0003330707550048828 nb_pixel_total : 13666 time to create 1 rle with old method : 0.015096902847290039 length of segment : 113 time for calcul the mask position with numpy : 0.0003094673156738281 nb_pixel_total : 8331 time to create 1 rle with old method : 0.009422540664672852 length of segment : 104 time for calcul the mask position with numpy : 0.00030922889709472656 nb_pixel_total : 8980 time to create 1 rle with old method : 0.010628700256347656 length of segment : 104 time for calcul the mask position with numpy : 0.0007340908050537109 nb_pixel_total : 19330 time to create 1 rle with old method : 0.022548437118530273 length of segment : 189 time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 15681 time to create 1 rle with old method : 0.01814436912536621 length of segment : 140 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 14113 time to create 1 rle with old method : 0.016422510147094727 length of segment : 105 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 4230 time to create 1 rle with old method : 0.005082845687866211 length of segment : 73 time for calcul the mask position with numpy : 0.0003006458282470703 nb_pixel_total : 7198 time to create 1 rle with old method : 0.008378028869628906 length of segment : 98 time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 5215 time to create 1 rle with old method : 0.006141185760498047 length of segment : 98 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 6708 time to create 1 rle with old method : 0.007500648498535156 length of segment : 107 time spent for convertir_results : 2.7710235118865967 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 69 chid ids of type : 3594 Number RLEs to save : 10253 save missing photos in datou_result : time spend for datou_step_exec : 26.328222513198853 time spend to save output : 0.6990706920623779 total time spend for step 1 : 27.02729320526123 step2:crop_condition Sat Nov 8 14:40:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 18 ! batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 3736932 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762609260_2219034 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276030_0.png', 0, 128, 124, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276031_0.png', 0, 228, 100, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276033_0.png', 0, 52, 166, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276034_0.png', 0, 98, 183, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276035_0.png', 0, 76, 72, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276036_0.png', 0, 104, 103, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276037_0.png', 0, 659, 352, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276038_0.png', 0, 98, 95, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276039_0.png', 0, 78, 63, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276040_0.png', 0, 71, 178, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276041_0.png', 0, 87, 100, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276042_0.png', 0, 311, 201, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276043_0.png', 0, 179, 148, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276044_0.png', 0, 159, 113, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276045_0.png', 0, 421, 137, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276047_0.png', 0, 256, 216, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276048_0.png', 0, 94, 184, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276049_0.png', 0, 154, 134, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276052_0.png', 0, 123, 111, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276054_0.png', 0, 76, 55, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276055_0.png', 0, 125, 105, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276058_0.png', 0, 103, 72, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276060_0.png', 0, 127, 112, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276064_0.png', 0, 71, 160, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276065_0.png', 0, 64, 91, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6_rle_crop_4027276067_0.png', 0, 101, 163, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6_rle_crop_4027276068_0.png', 0, 106, 46, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413799_f42e736006e64d580a833399b5a2cfb8_rle_crop_4027276069_0.png', 0, 233, 143, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276072_0.png', 0, 121, 118, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276073_0.png', 0, 108, 78, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276076_0.png', 0, 69, 118, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276077_0.png', 0, 65, 65, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276081_0.png', 0, 151, 103, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276084_0.png', 0, 96, 124, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276086_0.png', 0, 351, 323, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276087_0.png', 0, 135, 99, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276088_0.png', 0, 186, 118, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276090_0.png', 0, 133, 101, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276091_0.png', 0, 272, 158, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276092_0.png', 0, 145, 139, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276093_0.png', 0, 211, 100, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276094_0.png', 0, 102, 72, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609269), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276096_0.png', 0, 71, 98, 0, 1762609269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 43 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.529107332229614 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762609272_2219034 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609272), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276050_0.png', 0, 317, 504, 0, 1762609272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609272), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276051_0.png', 0, 158, 184, 0, 1762609272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609272), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276062_0.png', 0, 72, 41, 0, 1762609272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609272), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276082_0.png', 0, 186, 167, 0, 1762609272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3041954040527344 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762609273_2219034 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609274), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276070_0.png', 0, 86, 57, 0, 1762609274,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609274), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276075_0.png', 0, 113, 76, 0, 1762609274,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609274), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276089_0.png', 0, 110, 104, 0, 1762609274,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609274), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276095_0.png', 0, 106, 98, 0, 1762609274,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2907569408416748 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762609276_2219034 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276029_0.png', 0, 121, 74, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276032_0.png', 0, 90, 93, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276046_0.png', 0, 53, 57, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276053_0.png', 0, 329, 556, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276056_0.png', 0, 224, 58, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276059_0.png', 0, 195, 127, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276063_0.png', 0, 125, 242, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276066_0.png', 0, 220, 237, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc_rle_crop_4027276079_0.png', 0, 130, 225, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc_rle_crop_4027276080_0.png', 0, 92, 210, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276083_0.png', 0, 245, 121, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276085_0.png', 0, 155, 75, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609279), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276097_0.png', 0, 88, 107, 0, 1762609279,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.348176956176758 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762609280_2219034 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609281), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276057_0.png', 0, 44, 131, 0, 1762609281,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609281), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276061_0.png', 0, 38, 133, 0, 1762609281,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609281), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276074_0.png', 0, 41, 118, 0, 1762609281,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609281), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276078_0.png', 0, 40, 129, 0, 1762609281,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6610465049743652 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762609282_2219034 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762609282), 0.0, 0.0, 14, '', 0, 0, '1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276071_0.png', 0, 106, 101, 0, 1762609282,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7225136756896973 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393413891, 1393413889, 1393413887, 1393413883, 1393413880, 1393413812, 1393413810, 1393413807, 1393413805, 1393413802, 1393413799, 1393413792, 1393413790, 1393413788, 1393413786, 1393413784, 1393413783, 1393413730] Looping around the photos to save general results len do output : 69 /1393414628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393414696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413891', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413889', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413887', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413883', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413880', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413812', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413810', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413807', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413805', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413802', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413799', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413792', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413790', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413788', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413786', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413784', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413783', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413730', None, None, None, None, None, '4022882') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 225 time used for this insertion : 0.029371976852416992 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.289758920669556 time spend to save output : 0.03319191932678223 total time spend for step 2 : 26.322950839996338 step3:rle_unique_nms_with_priority Sat Nov 8 14:41:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.5923683643341064 time for calcul the mask position with numpy : 0.08632397651672363 nb_pixel_total : 2019254 time to create 1 rle with new method : 0.07746052742004395 time for calcul the mask position with numpy : 0.006234407424926758 nb_pixel_total : 3343 time to create 1 rle with old method : 0.0038690567016601562 time for calcul the mask position with numpy : 0.0059278011322021484 nb_pixel_total : 7872 time to create 1 rle with old method : 0.008651971817016602 time for calcul the mask position with numpy : 0.0062639713287353516 nb_pixel_total : 5999 time to create 1 rle with old method : 0.00664830207824707 time for calcul the mask position with numpy : 0.006019115447998047 nb_pixel_total : 5683 time to create 1 rle with old method : 0.006462812423706055 time for calcul the mask position with numpy : 0.006063699722290039 nb_pixel_total : 13371 time to create 1 rle with old method : 0.014842510223388672 time for calcul the mask position with numpy : 0.005965709686279297 nb_pixel_total : 11301 time to create 1 rle with old method : 0.01861405372619629 time for calcul the mask position with numpy : 0.006715536117553711 nb_pixel_total : 6777 time to create 1 rle with old method : 0.011117935180664062 create new chi : 0.2879664897918701 time to delete rle : 0.016883134841918945 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 2840 TO DO : save crop sub photo not yet done ! save time : 0.21713781356811523 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.07558560371398926 time for calcul the mask position with numpy : 0.22186875343322754 nb_pixel_total : 1873991 time to create 1 rle with new method : 0.09738492965698242 time for calcul the mask position with numpy : 0.006807088851928711 nb_pixel_total : 6363 time to create 1 rle with old method : 0.006906986236572266 time for calcul the mask position with numpy : 0.006143331527709961 nb_pixel_total : 283 time to create 1 rle with old method : 0.00039196014404296875 time for calcul the mask position with numpy : 0.006956815719604492 nb_pixel_total : 188420 time to create 1 rle with new method : 0.028258562088012695 time for calcul the mask position with numpy : 0.006067514419555664 nb_pixel_total : 4543 time to create 1 rle with old method : 0.0053005218505859375 create new chi : 0.38652515411376953 time to delete rle : 0.00036334991455078125 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 2378 TO DO : save crop sub photo not yet done ! save time : 0.1916346549987793 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.7232437133789062 time for calcul the mask position with numpy : 0.11250996589660645 nb_pixel_total : 1925692 time to create 1 rle with new method : 0.08447027206420898 time for calcul the mask position with numpy : 0.0066356658935546875 nb_pixel_total : 9596 time to create 1 rle with old method : 0.010854005813598633 time for calcul the mask position with numpy : 0.0072634220123291016 nb_pixel_total : 40126 time to create 1 rle with old method : 0.04518938064575195 time for calcul the mask position with numpy : 0.006576061248779297 nb_pixel_total : 2398 time to create 1 rle with old method : 0.002773761749267578 time for calcul the mask position with numpy : 0.0066454410552978516 nb_pixel_total : 32809 time to create 1 rle with old method : 0.036893367767333984 time for calcul the mask position with numpy : 0.006253242492675781 nb_pixel_total : 12369 time to create 1 rle with old method : 0.01389312744140625 time for calcul the mask position with numpy : 0.006261110305786133 nb_pixel_total : 17936 time to create 1 rle with old method : 0.019803524017333984 time for calcul the mask position with numpy : 0.007004737854003906 nb_pixel_total : 32674 time to create 1 rle with old method : 0.03619980812072754 create new chi : 0.41916394233703613 time to delete rle : 0.0004944801330566406 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 3586 TO DO : save crop sub photo not yet done ! save time : 0.2792832851409912 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04890799522399902 time for calcul the mask position with numpy : 0.019257307052612305 nb_pixel_total : 1952481 time to create 1 rle with new method : 0.20447635650634766 time for calcul the mask position with numpy : 0.007436275482177734 nb_pixel_total : 21632 time to create 1 rle with old method : 0.027043819427490234 time for calcul the mask position with numpy : 0.007226705551147461 nb_pixel_total : 86803 time to create 1 rle with old method : 0.09644103050231934 time for calcul the mask position with numpy : 0.006241559982299805 nb_pixel_total : 12684 time to create 1 rle with old method : 0.01422739028930664 create new chi : 0.3828394412994385 time to delete rle : 0.0003204345703125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2780 TO DO : save crop sub photo not yet done ! save time : 0.21146416664123535 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05381369590759277 time for calcul the mask position with numpy : 0.01980757713317871 nb_pixel_total : 1957760 time to create 1 rle with new method : 0.030248403549194336 time for calcul the mask position with numpy : 0.00648045539855957 nb_pixel_total : 1936 time to create 1 rle with old method : 0.002259492874145508 time for calcul the mask position with numpy : 0.006998300552368164 nb_pixel_total : 103895 time to create 1 rle with old method : 0.11416339874267578 time for calcul the mask position with numpy : 0.006229877471923828 nb_pixel_total : 10009 time to create 1 rle with old method : 0.010927438735961914 create new chi : 0.2067108154296875 time to delete rle : 0.0004200935363769531 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2562 TO DO : save crop sub photo not yet done ! save time : 0.19050192832946777 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.4224531650543213 time for calcul the mask position with numpy : 0.09467077255249023 nb_pixel_total : 2020666 time to create 1 rle with new method : 0.08538413047790527 time for calcul the mask position with numpy : 0.00668787956237793 nb_pixel_total : 21975 time to create 1 rle with old method : 0.024678468704223633 time for calcul the mask position with numpy : 0.00622868537902832 nb_pixel_total : 5770 time to create 1 rle with old method : 0.006579160690307617 time for calcul the mask position with numpy : 0.006224155426025391 nb_pixel_total : 3888 time to create 1 rle with old method : 0.00442051887512207 time for calcul the mask position with numpy : 0.006182432174682617 nb_pixel_total : 11574 time to create 1 rle with old method : 0.012954950332641602 time for calcul the mask position with numpy : 0.006209373474121094 nb_pixel_total : 9727 time to create 1 rle with old method : 0.011066675186157227 create new chi : 0.28169798851013184 time to delete rle : 0.00033855438232421875 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2070 TO DO : save crop sub photo not yet done ! save time : 0.16148996353149414 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.05518937110900879 time for calcul the mask position with numpy : 0.29258203506469727 nb_pixel_total : 2036671 time to create 1 rle with new method : 0.2525177001953125 time for calcul the mask position with numpy : 0.006599903106689453 nb_pixel_total : 21197 time to create 1 rle with old method : 0.023125648498535156 time for calcul the mask position with numpy : 0.006060361862182617 nb_pixel_total : 2392 time to create 1 rle with old method : 0.0027506351470947266 time for calcul the mask position with numpy : 0.005965709686279297 nb_pixel_total : 3362 time to create 1 rle with old method : 0.0038216114044189453 time for calcul the mask position with numpy : 0.0060651302337646484 nb_pixel_total : 9978 time to create 1 rle with old method : 0.011117696762084961 create new chi : 0.621204137802124 time to delete rle : 0.00034737586975097656 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2136 TO DO : save crop sub photo not yet done ! save time : 0.21267271041870117 No data in photo_id : 1393413807 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04878568649291992 time for calcul the mask position with numpy : 0.01890873908996582 nb_pixel_total : 2030398 time to create 1 rle with new method : 0.0756382942199707 time for calcul the mask position with numpy : 0.006392240524291992 nb_pixel_total : 32328 time to create 1 rle with old method : 0.03587174415588379 time for calcul the mask position with numpy : 0.006646156311035156 nb_pixel_total : 4919 time to create 1 rle with old method : 0.005471706390380859 time for calcul the mask position with numpy : 0.006379604339599609 nb_pixel_total : 5955 time to create 1 rle with old method : 0.006862640380859375 create new chi : 0.16256117820739746 time to delete rle : 0.0003809928894042969 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2064 TO DO : save crop sub photo not yet done ! save time : 0.1712629795074463 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.1816699504852295 time for calcul the mask position with numpy : 0.0711205005645752 nb_pixel_total : 2060517 time to create 1 rle with new method : 0.10195088386535645 time for calcul the mask position with numpy : 0.006621360778808594 nb_pixel_total : 3704 time to create 1 rle with old method : 0.004366159439086914 time for calcul the mask position with numpy : 0.006418466567993164 nb_pixel_total : 9379 time to create 1 rle with old method : 0.010610818862915039 create new chi : 0.21224713325500488 time to delete rle : 0.0002677440643310547 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1498 TO DO : save crop sub photo not yet done ! save time : 0.12229466438293457 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04781699180603027 time for calcul the mask position with numpy : 0.2291264533996582 nb_pixel_total : 2060930 time to create 1 rle with new method : 0.18560171127319336 time for calcul the mask position with numpy : 0.006917238235473633 nb_pixel_total : 12670 time to create 1 rle with old method : 0.019727468490600586 create new chi : 0.45662474632263184 time to delete rle : 0.0003330707550048828 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 1346 TO DO : save crop sub photo not yet done ! save time : 0.11874675750732422 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.2019956111907959 time for calcul the mask position with numpy : 0.06104564666748047 nb_pixel_total : 2051081 time to create 1 rle with new method : 0.09304380416870117 time for calcul the mask position with numpy : 0.006218433380126953 nb_pixel_total : 11069 time to create 1 rle with old method : 0.012212038040161133 time for calcul the mask position with numpy : 0.005941152572631836 nb_pixel_total : 7633 time to create 1 rle with old method : 0.008676290512084961 time for calcul the mask position with numpy : 0.006486654281616211 nb_pixel_total : 3817 time to create 1 rle with old method : 0.004149913787841797 create new chi : 0.2079932689666748 time to delete rle : 0.00029587745666503906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1640 TO DO : save crop sub photo not yet done ! save time : 0.1376488208770752 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.052463531494140625 time for calcul the mask position with numpy : 0.13187599182128906 nb_pixel_total : 2056134 time to create 1 rle with new method : 0.07513976097106934 time for calcul the mask position with numpy : 0.006041526794433594 nb_pixel_total : 6911 time to create 1 rle with old method : 0.007653713226318359 time for calcul the mask position with numpy : 0.006033182144165039 nb_pixel_total : 3441 time to create 1 rle with old method : 0.003889799118041992 time for calcul the mask position with numpy : 0.005675315856933594 nb_pixel_total : 7114 time to create 1 rle with old method : 0.007965564727783203 create new chi : 0.2543666362762451 time to delete rle : 0.0002872943878173828 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1642 TO DO : save crop sub photo not yet done ! save time : 0.17747807502746582 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05137515068054199 time for calcul the mask position with numpy : 0.04456281661987305 nb_pixel_total : 2060757 time to create 1 rle with new method : 0.16541695594787598 time for calcul the mask position with numpy : 0.006183624267578125 nb_pixel_total : 3293 time to create 1 rle with old method : 0.0037081241607666016 time for calcul the mask position with numpy : 0.006151914596557617 nb_pixel_total : 3259 time to create 1 rle with old method : 0.00371551513671875 time for calcul the mask position with numpy : 0.0061910152435302734 nb_pixel_total : 6291 time to create 1 rle with old method : 0.007097482681274414 create new chi : 0.25368475914001465 time to delete rle : 0.00030994415283203125 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1704 TO DO : save crop sub photo not yet done ! save time : 0.136671781539917 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04798245429992676 time for calcul the mask position with numpy : 0.02162480354309082 nb_pixel_total : 2037718 time to create 1 rle with new method : 0.0921330451965332 time for calcul the mask position with numpy : 0.006867647171020508 nb_pixel_total : 14535 time to create 1 rle with old method : 0.016262054443359375 time for calcul the mask position with numpy : 0.007051706314086914 nb_pixel_total : 21347 time to create 1 rle with old method : 0.023888111114501953 create new chi : 0.18034029006958008 time to delete rle : 0.0003540515899658203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1958 TO DO : save crop sub photo not yet done ! save time : 0.15014958381652832 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.19039177894592285 time for calcul the mask position with numpy : 0.09945821762084961 nb_pixel_total : 2021470 time to create 1 rle with new method : 0.10441946983337402 time for calcul the mask position with numpy : 0.006220102310180664 nb_pixel_total : 18163 time to create 1 rle with old method : 0.02016448974609375 time for calcul the mask position with numpy : 0.006150484085083008 nb_pixel_total : 21271 time to create 1 rle with old method : 0.023848533630371094 time for calcul the mask position with numpy : 0.006398677825927734 nb_pixel_total : 12696 time to create 1 rle with old method : 0.014201879501342773 create new chi : 0.29114556312561035 time to delete rle : 0.0003612041473388672 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1864 TO DO : save crop sub photo not yet done ! save time : 0.14780926704406738 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 0.3561270236968994 time for calcul the mask position with numpy : 0.06334853172302246 nb_pixel_total : 1925015 time to create 1 rle with new method : 0.09121251106262207 time for calcul the mask position with numpy : 0.0062580108642578125 nb_pixel_total : 14333 time to create 1 rle with old method : 0.015936851501464844 time for calcul the mask position with numpy : 0.0059814453125 nb_pixel_total : 19330 time to create 1 rle with old method : 0.0212552547454834 time for calcul the mask position with numpy : 0.006062507629394531 nb_pixel_total : 66 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.006016969680786133 nb_pixel_total : 8331 time to create 1 rle with old method : 0.009140968322753906 time for calcul the mask position with numpy : 0.006048440933227539 nb_pixel_total : 13640 time to create 1 rle with old method : 0.014641046524047852 time for calcul the mask position with numpy : 0.006514310836791992 nb_pixel_total : 7782 time to create 1 rle with old method : 0.008421182632446289 time for calcul the mask position with numpy : 0.006567716598510742 nb_pixel_total : 71280 time to create 1 rle with old method : 0.07845139503479004 time for calcul the mask position with numpy : 0.006417751312255859 nb_pixel_total : 7384 time to create 1 rle with old method : 0.008312463760375977 time for calcul the mask position with numpy : 0.006704092025756836 nb_pixel_total : 6439 time to create 1 rle with old method : 0.007308006286621094 create new chi : 0.38503336906433105 time to delete rle : 0.0006532669067382812 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 3872 TO DO : save crop sub photo not yet done ! save time : 0.266892671585083 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07144021987915039 time for calcul the mask position with numpy : 0.022206544876098633 nb_pixel_total : 2036136 time to create 1 rle with new method : 0.09603595733642578 time for calcul the mask position with numpy : 0.006249427795410156 nb_pixel_total : 6708 time to create 1 rle with old method : 0.007726192474365234 time for calcul the mask position with numpy : 0.0064640045166015625 nb_pixel_total : 5215 time to create 1 rle with old method : 0.0061266422271728516 time for calcul the mask position with numpy : 0.00610661506652832 nb_pixel_total : 7198 time to create 1 rle with old method : 0.008025884628295898 time for calcul the mask position with numpy : 0.005993366241455078 nb_pixel_total : 4230 time to create 1 rle with old method : 0.004701852798461914 time for calcul the mask position with numpy : 0.006056070327758789 nb_pixel_total : 14113 time to create 1 rle with old method : 0.015497446060180664 create new chi : 0.19160151481628418 time to delete rle : 0.00036835670471191406 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2042 TO DO : save crop sub photo not yet done ! save time : 0.16378450393676758 map_output_result : {1393413891: (0.0, 'Should be the crop_list due to order', 0), 1393413889: (0.0, 'Should be the crop_list due to order', 0), 1393413887: (0.0, 'Should be the crop_list due to order', 0), 1393413883: (0.0, 'Should be the crop_list due to order', 0), 1393413880: (0.0, 'Should be the crop_list due to order', 0), 1393413812: (0.0, 'Should be the crop_list due to order', 0), 1393413810: (0.0, 'Should be the crop_list due to order', 0), 1393413807: (0.0, 'Should be the crop_list due to order', 0.0), 1393413805: (0.0, 'Should be the crop_list due to order', 0), 1393413802: (0.0, 'Should be the crop_list due to order', 0), 1393413799: (0.0, 'Should be the crop_list due to order', 0), 1393413792: (0.0, 'Should be the crop_list due to order', 0), 1393413790: (0.0, 'Should be the crop_list due to order', 0), 1393413788: (0.0, 'Should be the crop_list due to order', 0), 1393413786: (0.0, 'Should be the crop_list due to order', 0), 1393413784: (0.0, 'Should be the crop_list due to order', 0), 1393413783: (0.0, 'Should be the crop_list due to order', 0), 1393413730: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393413891, 1393413889, 1393413887, 1393413883, 1393413880, 1393413812, 1393413810, 1393413807, 1393413805, 1393413802, 1393413799, 1393413792, 1393413790, 1393413788, 1393413786, 1393413784, 1393413783, 1393413730] Looping around the photos to save general results len do output : 18 /1393413891.Didn't retrieve data . /1393413889.Didn't retrieve data . /1393413887.Didn't retrieve data . /1393413883.Didn't retrieve data . /1393413880.Didn't retrieve data . /1393413812.Didn't retrieve data . /1393413810.Didn't retrieve data . /1393413807.Didn't retrieve data . /1393413805.Didn't retrieve data . /1393413802.Didn't retrieve data . /1393413799.Didn't retrieve data . /1393413792.Didn't retrieve data . /1393413790.Didn't retrieve data . /1393413788.Didn't retrieve data . /1393413786.Didn't retrieve data . /1393413784.Didn't retrieve data . /1393413783.Didn't retrieve data . /1393413730.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413891', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413889', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413887', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413883', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413880', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413812', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413810', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413807', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413805', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413802', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413799', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413792', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413790', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413788', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413786', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413784', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413783', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413730', None, None, None, None, None, '4022882') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.013947248458862305 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.017636060714722 time spend to save output : 0.014532804489135742 total time spend for step 3 : 12.032168865203857 step4:ventilate_hashtags_in_portfolio Sat Nov 8 14:41:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28354585 get user id for portfolio 28354585 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28354585 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','papier','pet_fonce','autre','background','pehd','mal_croppe','flou','carton','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28354585 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','papier','pet_fonce','autre','background','pehd','mal_croppe','flou','carton','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28354585 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','papier','pet_fonce','autre','background','pehd','mal_croppe','flou','carton','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28354629,28354630,28354631,28354632,28354633,28354634,28354635,28354636,28354637,28354638,28354639?tags=metal,environnement,papier,pet_fonce,autre,background,pehd,mal_croppe,flou,carton,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393413891, 1393413889, 1393413887, 1393413883, 1393413880, 1393413812, 1393413810, 1393413807, 1393413805, 1393413802, 1393413799, 1393413792, 1393413790, 1393413788, 1393413786, 1393413784, 1393413783, 1393413730] Looping around the photos to save general results len do output : 1 /28354585. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413891', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413889', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413887', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413883', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413880', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413812', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413810', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413807', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413805', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413802', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413799', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413792', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413790', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413788', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413786', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413784', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413783', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413730', None, None, None, None, None, '4022882') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.015662670135498047 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6597349643707275 time spend to save output : 0.0160214900970459 total time spend for step 4 : 1.6757564544677734 step5:final Sat Nov 8 14:41:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393413891: ('0.030128198945473268',), 1393413889: ('0.030128198945473268',), 1393413887: ('0.030128198945473268',), 1393413883: ('0.030128198945473268',), 1393413880: ('0.030128198945473268',), 1393413812: ('0.030128198945473268',), 1393413810: ('0.030128198945473268',), 1393413807: ('0.030128198945473268',), 1393413805: ('0.030128198945473268',), 1393413802: ('0.030128198945473268',), 1393413799: ('0.030128198945473268',), 1393413792: ('0.030128198945473268',), 1393413790: ('0.030128198945473268',), 1393413788: ('0.030128198945473268',), 1393413786: ('0.030128198945473268',), 1393413784: ('0.030128198945473268',), 1393413783: ('0.030128198945473268',), 1393413730: ('0.030128198945473268',)} new output for save of step final : {1393413891: ('0.030128198945473268',), 1393413889: ('0.030128198945473268',), 1393413887: ('0.030128198945473268',), 1393413883: ('0.030128198945473268',), 1393413880: ('0.030128198945473268',), 1393413812: ('0.030128198945473268',), 1393413810: ('0.030128198945473268',), 1393413807: ('0.030128198945473268',), 1393413805: ('0.030128198945473268',), 1393413802: ('0.030128198945473268',), 1393413799: ('0.030128198945473268',), 1393413792: ('0.030128198945473268',), 1393413790: ('0.030128198945473268',), 1393413788: ('0.030128198945473268',), 1393413786: ('0.030128198945473268',), 1393413784: ('0.030128198945473268',), 1393413783: ('0.030128198945473268',), 1393413730: ('0.030128198945473268',)} [1393413891, 1393413889, 1393413887, 1393413883, 1393413880, 1393413812, 1393413810, 1393413807, 1393413805, 1393413802, 1393413799, 1393413792, 1393413790, 1393413788, 1393413786, 1393413784, 1393413783, 1393413730] Looping around the photos to save general results len do output : 18 /1393413891.Didn't retrieve data . /1393413889.Didn't retrieve data . /1393413887.Didn't retrieve data . /1393413883.Didn't retrieve data . /1393413880.Didn't retrieve data . /1393413812.Didn't retrieve data . /1393413810.Didn't retrieve data . /1393413807.Didn't retrieve data . /1393413805.Didn't retrieve data . /1393413802.Didn't retrieve data . /1393413799.Didn't retrieve data . /1393413792.Didn't retrieve data . /1393413790.Didn't retrieve data . /1393413788.Didn't retrieve data . /1393413786.Didn't retrieve data . /1393413784.Didn't retrieve data . /1393413783.Didn't retrieve data . /1393413730.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413891', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413889', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413887', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413883', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413880', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413812', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413810', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413807', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413805', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413802', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413799', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413792', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413790', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413788', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413786', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413784', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413783', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413730', None, None, None, None, None, '4022882') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.01638174057006836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1329193115234375 time spend to save output : 0.017229795455932617 total time spend for step 5 : 0.15014910697937012 step6:blur_detection Sat Nov 8 14:41:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca.jpg resize: (1080, 1920) 1393413891 -1.1221619343305962 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b.jpg resize: (1080, 1920) 1393413889 0.44827195604243525 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60.jpg resize: (1080, 1920) 1393413887 -0.019325847191235073 treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c.jpg resize: (1080, 1920) 1393413883 -0.3636285887492595 treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5.jpg resize: (1080, 1920) 1393413880 -0.3567413532766641 treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d.jpg resize: (1080, 1920) 1393413812 0.6058911264772869 treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322.jpg resize: (1080, 1920) 1393413810 0.72691913659128 treat image : temp/1762609227_2219034_1393413807_c56da9c158d752738ce260f818a0ccfb.jpg resize: (1080, 1920) 1393413807 0.5547537406566687 treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e.jpg resize: (1080, 1920) 1393413805 -0.39830449113043126 treat image : temp/1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6.jpg resize: (1080, 1920) 1393413802 1.618991340726379 treat image : temp/1762609227_2219034_1393413799_f42e736006e64d580a833399b5a2cfb8.jpg resize: (1080, 1920) 1393413799 0.16968187290804473 treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8.jpg resize: (1080, 1920) 1393413792 0.9633476987264937 treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209.jpg resize: (1080, 1920) 1393413790 -0.9109110437352408 treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1.jpg resize: (1080, 1920) 1393413788 0.17441850304987308 treat image : temp/1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc.jpg resize: (1080, 1920) 1393413786 1.491771439942877 treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7.jpg resize: (1080, 1920) 1393413784 0.9438437706857248 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80.jpg resize: (1080, 1920) 1393413783 -0.22904074467899513 treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2.jpg resize: (1080, 1920) 1393413730 2.125714385270825 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276030_0.png resize: (124, 128) 1393414628 -3.925169649741071 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276031_0.png resize: (100, 228) 1393414629 0.7029705835382439 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276033_0.png resize: (166, 52) 1393414630 -1.218678375826845 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276034_0.png resize: (183, 98) 1393414631 -2.046223928084977 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276035_0.png resize: (72, 76) 1393414632 -1.38036821716064 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276036_0.png resize: (103, 104) 1393414633 -2.584000573141077 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276037_0.png resize: (352, 659) 1393414634 -2.4107556790555424 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276038_0.png resize: (95, 98) 1393414635 -2.0219304328009504 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276039_0.png resize: (63, 78) 1393414636 3.6247709743804557 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276040_0.png resize: (178, 71) 1393414637 -2.276158282751259 treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276041_0.png resize: (100, 87) 1393414638 -2.358899658095457 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276042_0.png resize: (201, 311) 1393414639 -1.9648450228691152 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276043_0.png resize: (148, 179) 1393414640 0.44216631892545494 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276044_0.png resize: (113, 159) 1393414641 -2.261781500877958 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276045_0.png resize: (137, 421) 1393414642 -1.604298239985361 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276047_0.png resize: (216, 256) 1393414643 -1.377644769496542 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276048_0.png resize: (184, 94) 1393414644 -1.5821115282755904 treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276049_0.png resize: (134, 154) 1393414645 -0.29601847672824627 treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276052_0.png resize: (111, 123) 1393414646 -1.318152854688069 treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276054_0.png resize: (55, 76) 1393414647 -3.475641415130405 treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276055_0.png resize: (105, 125) 1393414648 -0.6851761398716351 treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276058_0.png resize: (72, 103) 1393414649 -1.0806047621274955 treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276060_0.png resize: (112, 127) 1393414650 -1.2673128683171795 treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276064_0.png resize: (160, 71) 1393414651 -1.8649161754327892 treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276065_0.png resize: (91, 64) 1393414652 7.727648134003878 treat image : temp/1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6_rle_crop_4027276067_0.png resize: (163, 101) 1393414653 -1.3753686584027756 treat image : temp/1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6_rle_crop_4027276068_0.png resize: (46, 106) 1393414654 1.2986749305417817 treat image : temp/1762609227_2219034_1393413799_f42e736006e64d580a833399b5a2cfb8_rle_crop_4027276069_0.png resize: (143, 233) 1393414655 -1.3776099360852783 treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276072_0.png resize: (118, 121) 1393414656 1.5598296159757712 treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276073_0.png resize: (78, 108) 1393414657 0.5318180194114094 treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276076_0.png resize: (118, 69) 1393414658 -0.8650976636148567 treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276077_0.png resize: (65, 65) 1393414659 2.429550640480674 treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276081_0.png resize: (103, 151) 1393414660 1.1637134976527028 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276084_0.png resize: (124, 96) 1393414661 -1.683000442372824 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276086_0.png resize: (323, 351) 1393414662 -2.3717373331230522 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276087_0.png resize: (99, 135) 1393414663 -1.2991508307739803 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276088_0.png resize: (118, 186) 1393414664 0.6472987974240096 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276090_0.png resize: (101, 133) 1393414665 -2.2888388809169657 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276091_0.png resize: (158, 272) 1393414666 -1.7795875895496436 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276092_0.png resize: (139, 145) 1393414667 -3.208268744288986 treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276093_0.png resize: (100, 211) 1393414668 -0.2358661000907677 treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276094_0.png resize: (72, 102) 1393414669 -3.1721774607687747 treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276096_0.png resize: (98, 71) 1393414670 0.3892981855904732 treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276050_0.png resize: (504, 317) 1393414671 -0.7907759361033744 treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276051_0.png resize: (184, 158) 1393414672 -0.9288821717302844 treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276062_0.png resize: (41, 72) 1393414673 20.0 treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276082_0.png resize: (167, 186) 1393414674 -1.717665185858704 treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276070_0.png resize: (57, 86) 1393414675 -3.9553756266094062 treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276075_0.png resize: (76, 113) 1393414676 -0.4916494320374754 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276089_0.png resize: (104, 110) 1393414677 -2.4487874365401803 treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276095_0.png resize: (98, 106) 1393414678 -1.944795833679461 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276029_0.png resize: (74, 121) 1393414679 -2.8836032517704013 treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276032_0.png resize: (93, 90) 1393414680 -1.236637257311073 treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276046_0.png resize: (57, 53) 1393414681 0.7210215344443973 treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276053_0.png resize: (556, 329) 1393414682 -0.2669303807853691 treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276056_0.png resize: (58, 224) 1393414683 5.103127528559783 treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276059_0.png resize: (127, 195) 1393414684 -0.0996148868257269 treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276063_0.png resize: (242, 125) 1393414685 -1.1055134986559336 treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276066_0.png resize: (237, 220) 1393414686 -1.2229344130236086 treat image : temp/1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc_rle_crop_4027276079_0.png resize: (225, 130) 1393414687 -0.83595129373644 treat image : temp/1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc_rle_crop_4027276080_0.png resize: (210, 92) 1393414688 -0.0056160277175065715 treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276083_0.png resize: (121, 245) 1393414689 -1.5162191801952059 treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276085_0.png resize: (75, 155) 1393414690 -1.415504530074263 treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276097_0.png resize: (107, 88) 1393414691 -2.896022871124241 treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276057_0.png resize: (131, 44) 1393414692 -1.8148537214618783 treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276061_0.png resize: (133, 38) 1393414693 -1.7065386885030065 treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276074_0.png resize: (118, 41) 1393414694 -2.571004617268854 treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276078_0.png resize: (129, 40) 1393414695 -2.7463449516553124 treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276071_0.png resize: (101, 106) 1393414696 0.45400779563869775 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.015244007110595703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.01550149917602539 save missing photos in datou_result : time spend for datou_step_exec : 14.61159372329712 time spend to save output : 0.036221981048583984 total time spend for step 6 : 14.647815704345703 step7:brightness Sat Nov 8 14:41:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca.jpg treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b.jpg treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60.jpg treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c.jpg treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5.jpg treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d.jpg treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322.jpg treat image : temp/1762609227_2219034_1393413807_c56da9c158d752738ce260f818a0ccfb.jpg treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e.jpg treat image : temp/1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6.jpg treat image : temp/1762609227_2219034_1393413799_f42e736006e64d580a833399b5a2cfb8.jpg treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8.jpg treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209.jpg treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1.jpg treat image : temp/1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc.jpg treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7.jpg treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80.jpg treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2.jpg treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276030_0.png treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276031_0.png treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276033_0.png treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276034_0.png treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276035_0.png treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276036_0.png treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276037_0.png treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276038_0.png treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276039_0.png treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276040_0.png treat image : temp/1762609227_2219034_1393413889_1b91cf8512676a1ba91ede879e10c60b_rle_crop_4027276041_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276042_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276043_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276044_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276045_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276047_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276048_0.png treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276049_0.png treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276052_0.png treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276054_0.png treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276055_0.png treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276058_0.png treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276060_0.png treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276064_0.png treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276065_0.png treat image : temp/1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6_rle_crop_4027276067_0.png treat image : temp/1762609227_2219034_1393413802_7bc620f3f1e7e5c0d2c86d93bd0b68b6_rle_crop_4027276068_0.png treat image : temp/1762609227_2219034_1393413799_f42e736006e64d580a833399b5a2cfb8_rle_crop_4027276069_0.png treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276072_0.png treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276073_0.png treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276076_0.png treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276077_0.png treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276081_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276084_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276086_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276087_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276088_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276090_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276091_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276092_0.png treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276093_0.png treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276094_0.png treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276096_0.png treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276050_0.png treat image : temp/1762609227_2219034_1393413883_a06bd03f487655a2f48998c068f2d80c_rle_crop_4027276051_0.png treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276062_0.png treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276082_0.png treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276070_0.png treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276075_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276089_0.png treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276095_0.png treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276029_0.png treat image : temp/1762609227_2219034_1393413891_53ef4ea0c8c6cc2ae3e5f413eb97dfca_rle_crop_4027276032_0.png treat image : temp/1762609227_2219034_1393413887_7c202ab54ce71da0662268e88d6a0e60_rle_crop_4027276046_0.png treat image : temp/1762609227_2219034_1393413880_f323a1df6815eed4eff62308eadfdad5_rle_crop_4027276053_0.png treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276056_0.png treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276059_0.png treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276063_0.png treat image : temp/1762609227_2219034_1393413805_abd0416b1552b752bf778e5d0c07821e_rle_crop_4027276066_0.png treat image : temp/1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc_rle_crop_4027276079_0.png treat image : temp/1762609227_2219034_1393413786_ef468410ad0594a75a476b7b5e488cfc_rle_crop_4027276080_0.png treat image : temp/1762609227_2219034_1393413784_15baaaaa7ecc68c9f0275338ba37d2b7_rle_crop_4027276083_0.png treat image : temp/1762609227_2219034_1393413783_5dab17b3f18382b0b550389f6b511c80_rle_crop_4027276085_0.png treat image : temp/1762609227_2219034_1393413730_121a66426352da0296d37275b92968f2_rle_crop_4027276097_0.png treat image : temp/1762609227_2219034_1393413812_0aeb66595acb1e8761f1736bf012d56d_rle_crop_4027276057_0.png treat image : temp/1762609227_2219034_1393413810_0d8ef466f9835cd6070ad9a0e74e0322_rle_crop_4027276061_0.png treat image : temp/1762609227_2219034_1393413790_28f1e0616a9141c746e3a1f770032209_rle_crop_4027276074_0.png treat image : temp/1762609227_2219034_1393413788_2928ecbcdf99508f640b0e60544e37f1_rle_crop_4027276078_0.png treat image : temp/1762609227_2219034_1393413792_c1c9cf7f6f05553cf8453032db2537e8_rle_crop_4027276071_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 87 time used for this insertion : 0.016551971435546875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 87 time used for this insertion : 0.017567157745361328 save missing photos in datou_result : time spend for datou_step_exec : 4.0926008224487305 time spend to save output : 0.03970694541931152 total time spend for step 7 : 4.132307767868042 step8:velours_tree Sat Nov 8 14:41:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08794856071472168 time spend to save output : 4.029273986816406e-05 total time spend for step 8 : 0.08798885345458984 step9:send_mail_cod Sat Nov 8 14:41:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28354585_08-11-2025_14_41_55.pdf 28354629 change filename to text .change filename to text .change filename to text .change filename to text .imagette283546291762609315 28354631 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283546311762609316 28354632 imagette283546321762609317 28354633 change filename to text .change filename to text .change filename to text .change filename to text .imagette283546331762609317 28354634 imagette283546341762609317 28354635 change filename to text .imagette283546351762609317 28354636 imagette283546361762609317 28354637 imagette283546371762609317 28354638 change filename to text .change filename to text .change filename to text .change filename to text .imagette283546381762609317 28354639 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette283546391762609318 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28354585 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28354629,28354630,28354631,28354632,28354633,28354634,28354635,28354636,28354637,28354638,28354639?tags=metal,environnement,papier,pet_fonce,autre,background,pehd,mal_croppe,flou,carton,pet_clair args[1393413891] : ((1393413891, -1.1221619343305962, 492688767), (1393413891, 0.6023878723342523, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413889] : ((1393413889, 0.44827195604243525, 492688767), (1393413889, 0.5115650007853314, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413887] : ((1393413887, -0.019325847191235073, 492688767), (1393413887, 0.7064069606715355, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413883] : ((1393413883, -0.3636285887492595, 492688767), (1393413883, 0.3384868028688323, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413880] : ((1393413880, -0.3567413532766641, 492688767), (1393413880, 0.5932737472377484, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413812] : ((1393413812, 0.6058911264772869, 492688767), (1393413812, 0.5939986821696585, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413810] : ((1393413810, 0.72691913659128, 492688767), (1393413810, 0.36718294762921283, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413807] : ((1393413807, 0.5547537406566687, 492688767), (1393413807, 0.44972643893057146, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413805] : ((1393413805, -0.39830449113043126, 492688767), (1393413805, 0.6198327988223008, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413802] : ((1393413802, 1.618991340726379, 492688767), (1393413802, 0.5626814974602004, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413799] : ((1393413799, 0.16968187290804473, 492688767), (1393413799, 0.699216280305854, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413792] : ((1393413792, 0.9633476987264937, 492688767), (1393413792, 0.7037769771625926, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413790] : ((1393413790, -0.9109110437352408, 492688767), (1393413790, 0.507038120441994, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413788] : ((1393413788, 0.17441850304987308, 492688767), (1393413788, 0.3993076098002443, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413786] : ((1393413786, 1.491771439942877, 492688767), (1393413786, 0.692677211738353, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413784] : ((1393413784, 0.9438437706857248, 492688767), (1393413784, 0.5013901663253563, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413783] : ((1393413783, -0.22904074467899513, 492688767), (1393413783, 0.4835619841240874, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com args[1393413730] : ((1393413730, 2.125714385270825, 492688767), (1393413730, 0.6279523814839592, 2107752395), '0.030128198945473268') We are sending mail with results at report@fotonower.com refus_total : 0.030128198945473268 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28354585 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28354585_08-11-2025_14_41_55.pdf results_Auto_P28354585_08-11-2025_14_41_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28354585_08-11-2025_14_41_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28354585','results_Auto_P28354585_08-11-2025_14_41_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28354585_08-11-2025_14_41_55.pdf','pdf','','0.25','0.030128198945473268') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28354585

https://www.fotonower.com/image?json=false&list_photos_id=1393413891
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413889
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413887
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413883
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413880
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413812
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413810
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413807
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413802
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.618991340726379)
https://www.fotonower.com/image?json=false&list_photos_id=1393413799
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413792
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413790
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413788
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413786
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.491771439942877)
https://www.fotonower.com/image?json=false&list_photos_id=1393413784
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413783
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393413730
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.125714385270825)

Dans ces conditions,le taux de refus est: 3.01%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/28354629?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28354631?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28354633?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/28354635?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28354638?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28354639?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28354585_08-11-2025_14_41_55.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28354629,28354630,28354631,28354632,28354633,28354634,28354635,28354636,28354637,28354638,28354639?tags=metal,environnement,papier,pet_fonce,autre,background,pehd,mal_croppe,flou,carton,pet_clair.


L'équipe Fotonower 202 b'' Date: Sat, 08 Nov 2025 13:42:01 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: trqWKDKRRmWQHVJPWOqkFA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393413891, 1393413889, 1393413887, 1393413883, 1393413880, 1393413812, 1393413810, 1393413807, 1393413805, 1393413802, 1393413799, 1393413792, 1393413790, 1393413788, 1393413786, 1393413784, 1393413783, 1393413730] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413891', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413889', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413887', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413883', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413880', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413812', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413810', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413807', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413805', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413802', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413799', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413792', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413790', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413788', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413786', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413784', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413783', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413730', None, None, None, None, None, '4022882') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.01657557487487793 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.368001222610474 time spend to save output : 0.016866683959960938 total time spend for step 9 : 5.384867906570435 step10:split_time_score Sat Nov 8 14:42:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 18),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08112025 28354585 Nombre de photos uploadées : 18 / 23040 (0%) 08112025 28354585 Nombre de photos taguées (types de déchets): 0 / 18 (0%) 08112025 28354585 Nombre de photos taguées (volume) : 0 / 18 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ?????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009632110595703125 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20508885383605957 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09208728780864198 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28348936_08-11-2025_11_01_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28348936 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28348936 AND mptpi.`type`=3594 To do Qualite : 0.014007296205519245 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352790_08-11-2025_12_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352790 AND mptpi.`type`=3594 To do Qualite : 0.036939662101337443 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352791_08-11-2025_13_22_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352791 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352791 AND mptpi.`type`=3594 To do Qualite : 0.05141876929012345 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352794_08-11-2025_13_12_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352794 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352794 AND mptpi.`type`=3594 To do Qualite : 0.05583881896219136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28352797_08-11-2025_11_51_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28352797 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28352797 AND mptpi.`type`=3594 To do Qualite : 0.10897292148919753 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28353418_08-11-2025_12_51_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28353418 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28353418 AND mptpi.`type`=3594 To do Qualite : 0.2131274112654321 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28353420_08-11-2025_12_42_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28353420 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28353420 AND mptpi.`type`=3594 To do Qualite : 0.030128198945473268 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28354585_08-11-2025_14_41_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28354585 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28354585 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08112025': {'nb_upload': 18, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393413891, 1393413889, 1393413887, 1393413883, 1393413880, 1393413812, 1393413810, 1393413807, 1393413805, 1393413802, 1393413799, 1393413792, 1393413790, 1393413788, 1393413786, 1393413784, 1393413783, 1393413730] Looping around the photos to save general results len do output : 1 /28354585Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413891', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413889', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413887', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413883', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413880', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413812', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413810', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413807', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413805', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413802', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413799', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413792', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413790', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413788', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413786', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413784', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413783', None, None, None, None, None, '4022882') ('3318', None, None, None, None, None, None, None, '4022882') ('3318', '28354585', '1393413730', None, None, None, None, None, '4022882') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.01565408706665039 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8479189872741699 time spend to save output : 0.01594686508178711 total time spend for step 10 : 0.863865852355957 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 49.05user 23.38system 1:36.89elapsed 74%CPU (0avgtext+0avgdata 2998204maxresident)k 479424inputs+20888outputs (19major+2026233minor)pagefaults 0swaps