Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22479325 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 0.5243422985076904 # DISPLAY ALL COLLECTED DATA : {'29042025': {'nb_upload': 189, 'nb_taggue_class': 164, 'nb_taggue_densite': 164}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1354075267, 1354075259, 1354075253, 1354075213, 1354075208, 1354075189, 1354075186, 1354075183, 1354075181, 1354075179, 1354075115, 1354075112, 1354075065, 1354075004, 1354074873, 1354074861, 1354074806, 1354074788, 1354074782, 1354074722, 1354074714, 1354074679, 1354074668, 1354074660, 1354074655, 1354074510, 1354074505, 1354074499, 1354074384, 1354074353, 1354074321, 1354074028, 1354073999, 1354073961, 1354073896, 1354073348, 1354073340, 1354073334, 1354072890, 1354072884, 1354072334, 1354072164, 1354072156, 1354072148, 1354072096, 1354072080, 1354072033, 1354072027, 1354072021, 1354072015, 1354072001, 1354071954, 1354071952, 1354071947, 1354071942, 1354071896, 1354071894, 1354071892, 1354071524, 1354071513, 1354071503, 1354071494, 1354071478, 1354071438, 1354071436, 1354071431, 1354071427, 1354071423, 1354071280, 1354071272, 1354071263, 1354070953, 1354070885, 1354070852, 1354070819, 1354070789, 1354070623, 1354070620, 1354070612, 1354070607, 1354070605, 1354070417, 1354070415, 1354070411, 1354070178, 1354070177, 1354070176, 1354070173, 1354070088, 1354069913, 1354069912, 1354069910, 1354069908, 1354069904, 1354069770, 1354069768, 1354069759, 1354069671, 1354069668, 1354069660] Looping around the photos to save general results len do output : 1 /22476853Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075267', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075259', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075253', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075213', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075208', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075189', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075186', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075183', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075181', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075179', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075115', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075112', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075065', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354075004', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074873', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074861', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074806', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074788', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074782', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074722', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074714', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074679', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074668', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074660', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074655', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074510', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074505', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074499', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074384', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074353', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074321', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354074028', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354073999', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354073961', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354073896', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354073348', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354073340', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354073334', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072890', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072884', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072334', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072164', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072156', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072148', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072096', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072080', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072033', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072027', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072021', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072015', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354072001', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071954', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071952', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071947', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071942', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071896', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071894', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071892', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071524', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071513', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071503', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071494', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071478', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071438', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071436', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071431', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071427', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071423', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071280', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071272', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354071263', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070953', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070885', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070852', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070819', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070789', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070623', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070620', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070612', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070607', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070605', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070417', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070415', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070411', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070178', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070177', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070176', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070173', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354070088', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069913', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069912', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069910', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069908', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069904', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069770', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069768', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069759', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069671', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069668', None, None, None, None, None, '2766813') ('4876', None, None, None, None, None, None, None, '2766813') ('4876', '22476853', '1354069660', None, None, None, None, None, '2766813') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.12174463272094727 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6902430057525635 time spend to save output : 0.12273669242858887 total time spend for step 1 : 0.8129796981811523 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.27user 0.79system 0:05.23elapsed 39%CPU (0avgtext+0avgdata 101672maxresident)k 1544inputs+80outputs (39major+49164minor)pagefaults 0swaps