python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4302 -v ' -s datou_current_4302 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Namespace(auto=False, cert_args='/home/fotonower/https/cert.pem', contextDataFile='', custom_size=0, database='', datou_id='4302', datou_id_excluded='', fifo=False, host='', is_cpu_mode=False, job='batch_current', json_args='', key_args='/home/fotonower/https/vision.fotonower.com.key', limit=1000, list_photo_ids='', local='', mtr_current_id=0, mtr_portfolio_ids='', nb_thread=1, no_current=False, offset=0, only_client=False, output_file='', password='', port=5100, rand=0, save=2, use_client=False, user_id=440, username='', verbose=True) process id : 2501058 load datou : 4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type seems boolean for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current 4302 [] TODO datou_current to load to do maybe to take outside batchDatouExec SELECT * from MTRPhoto.mtr_datou_current where state = 0 AND mtr_portfolio_id is not NULL AND mtd_id = 4302 order by created_at desc LIMIT 1 UPDATE MTRPhoto.mtr_datou_current SET state=1, hostname='marlene' WHERE id in (3958019) updating current state to 1 UPDATE MTRPhoto.mtr_datou_current SET state=1, hostname='marlene' WHERE id in (3958019) SELECT count(*) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 27892251 AND hide_status = 0 list_input_json: [] Current got : datou_id : 4302, datou_cur_ids : ['3958019'] with mtr_portfolio_ids : ['27892251'] and first list_photo_ids : [] new path : /proc/2501058/ Name: python3 Umask: 0002 State: R (running) Tgid: 2501058 Ngid: 0 Pid: 2501058 PPid: 2501057 TracerPid: 0 Uid: 1006 1006 1006 1006 Gid: 1009 1009 1009 1009 FDSize: 64 Groups: 27 1009 1026 NStgid: 2501058 NSpid: 2501058 NSpgid: 2495586 NSsid: 2495586 VmPeak: 1106868 kB VmSize: 1106868 kB VmLck: 0 kB VmPin: 0 kB VmHWM: 98736 kB VmRSS: 98736 kB RssAnon: 59848 kB RssFile: 38888 kB RssShmem: 0 kB VmData: 865620 kB VmStk: 132 kB VmExe: 2644 kB VmLib: 130468 kB VmPTE: 612 kB VmSwap: 0 kB HugetlbPages: 0 kB CoreDumping: 0 THP_enabled: 1 Threads: 1 SigQ: 0/63019 SigPnd: 0000000000000000 ShdPnd: 0000000000000000 SigBlk: 0000000000000000 SigIgn: 0000000001001000 SigCgt: 0000000180000002 CapInh: 0000000000000000 CapPrm: 0000000000000000 CapEff: 0000000000000000 CapBnd: 000001ffffffffff CapAmb: 0000000000000000 NoNewPrivs: 0 Seccomp: 0 Seccomp_filters: 0 Speculation_Store_Bypass: thread vulnerable SpeculationIndirectBranch: conditional enabled Cpus_allowed: ffffffff,ffffffff,ffffffff,ffffffff Cpus_allowed_list: 0-127 Mems_allowed: 00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000001 Mems_allowed_list: 0 voluntary_ctxt_switches: 62 nonvoluntary_ctxt_switches: 94 {'Name': 'python3', 'Umask': '0002', 'State': 'R (running)', 'Tgid': '2501058', 'Ngid': '0', 'Pid': '2501058', 'PPid': '2501057', 'TracerPid': '0', 'Uid': '1006,1006,1006,1006', 'Gid': '1009,1009,1009,1009', 'FDSize': '64', 'Groups': '27 1009 1026', 'NStgid': '2501058', 'NSpid': '2501058', 'NSpgid': '2495586', 'NSsid': '2495586', 'VmPeak': '1106868 kB', 'VmSize': '1106868 kB', 'VmLck': '0 kB', 'VmPin': '0 kB', 'VmHWM': '98736 kB', 'VmRSS': '98736 kB', 'RssAnon': '59848 kB', 'RssFile': '38888 kB', 'RssShmem': '0 kB', 'VmData': '865620 kB', 'VmStk': '132 kB', 'VmExe': '2644 kB', 'VmLib': '130468 kB', 'VmPTE': '612 kB', 'VmSwap': '0 kB', 'HugetlbPages': '0 kB', 'CoreDumping': '0', 'THP_enabled': '1', 'Threads': '1', 'SigQ': '0/63019', 'SigPnd': '0000000000000000', 'ShdPnd': '0000000000000000', 'SigBlk': '0000000000000000', 'SigIgn': '0000000001001000', 'SigCgt': '0000000180000002', 'CapInh': '0000000000000000', 'CapPrm': '0000000000000000', 'CapEff': '0000000000000000', 'CapBnd': '000001ffffffffff', 'CapAmb': '0000000000000000', 'NoNewPrivs': '0', 'Seccomp': '0', 'Seccomp_filters': '0', 'Speculation_Store_Bypass': 'thread vulnerable', 'SpeculationIndirectBranch': 'conditional enabled', 'Cpus_allowed': 'ffffffff,ffffffff,ffffffff,ffffffff', 'Cpus_allowed_list': '0-127', 'Mems_allowed': '00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000001', 'Mems_allowed_list': '0', 'voluntary_ctxt_switches': '62', 'nonvoluntary_ctxt_switches': '94'} ('datou_batch_current', '2501058', '1106868', '0', '1106868', '865620', '98736', b'', 'marlene', '3958019') insert ignore into MTRAdmin.mem_info (script_name, PID, VMpeak,VMswap,VMsize,VMdata,VMrss,GPU_ram, hostname, mtr_current_id) VALUES (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s) Inside batchDatouExec : verbose : True ##### chargement datou SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! no param json to modify List Step Type Loaded in datou : ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 200 list_input_json : [] ##### fin chargement datou ##### chargement data ##### Call load_data_input : nb_thread : 1 origin SELECT ph.photo_id, ph.url FROM MTRBack.photos_view ph WHERE ph.photo_id IN (SELECT mtr_photo_id from MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (27892251) and hide_status = 0 ) AND ph.photo_id not in (SELECT mtr_photo_id from MTRPhoto.mtr_datou_result_search where mtr_current_id in (3958019 ) ) ORDER BY ph.photo_id DESC LIMIT 0, 200 We have 1 , {} SELECT mtr_photo_id, mtr_portfolio_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id in (27892251) AND hide_status = 0 ORDER by mtr_photo_id desc LIMIT 0, 200 list_result: [{'photo_id': 1389865924, 'portfolio_id': 27892251}, {'photo_id': 1389865921, 'portfolio_id': 27892251}, {'photo_id': 1389865917, 'portfolio_id': 27892251}, {'photo_id': 1389865915, 'portfolio_id': 27892251}, {'photo_id': 1389865877, 'portfolio_id': 27892251}, {'photo_id': 1389865874, 'portfolio_id': 27892251}, {'photo_id': 1389865870, 'portfolio_id': 27892251}, {'photo_id': 1389865551, 'portfolio_id': 27892251}, {'photo_id': 1389865547, 'portfolio_id': 27892251}, {'photo_id': 1389864998, 'portfolio_id': 27892251}, {'photo_id': 1389864994, 'portfolio_id': 27892251}, {'photo_id': 1389864990, 'portfolio_id': 27892251}, {'photo_id': 1389864987, 'portfolio_id': 27892251}, {'photo_id': 1389864983, 'portfolio_id': 27892251}, {'photo_id': 1389864978, 'portfolio_id': 27892251}, {'photo_id': 1389864021, 'portfolio_id': 27892251}, {'photo_id': 1389864019, 'portfolio_id': 27892251}, {'photo_id': 1389864016, 'portfolio_id': 27892251}, {'photo_id': 1389863983, 'portfolio_id': 27892251}, {'photo_id': 1389863976, 'portfolio_id': 27892251}, {'photo_id': 1389863972, 'portfolio_id': 27892251}, {'photo_id': 1389863969, 'portfolio_id': 27892251}, {'photo_id': 1389863967, 'portfolio_id': 27892251}, {'photo_id': 1389863964, 'portfolio_id': 27892251}, {'photo_id': 1389863948, 'portfolio_id': 27892251}, {'photo_id': 1389863945, 'portfolio_id': 27892251}, {'photo_id': 1389863943, 'portfolio_id': 27892251}, {'photo_id': 1389863940, 'portfolio_id': 27892251}, {'photo_id': 1389863921, 'portfolio_id': 27892251}, {'photo_id': 1389863912, 'portfolio_id': 27892251}, {'photo_id': 1389863909, 'portfolio_id': 27892251}, {'photo_id': 1389863906, 'portfolio_id': 27892251}, {'photo_id': 1389863904, 'portfolio_id': 27892251}, {'photo_id': 1389863901, 'portfolio_id': 27892251}, {'photo_id': 1389863883, 'portfolio_id': 27892251}, {'photo_id': 1389863880, 'portfolio_id': 27892251}, {'photo_id': 1389863878, 'portfolio_id': 27892251}, {'photo_id': 1389863876, 'portfolio_id': 27892251}, {'photo_id': 1389863861, 'portfolio_id': 27892251}, {'photo_id': 1389863858, 'portfolio_id': 27892251}, {'photo_id': 1389863855, 'portfolio_id': 27892251}, {'photo_id': 1389863852, 'portfolio_id': 27892251}, {'photo_id': 1389863848, 'portfolio_id': 27892251}, {'photo_id': 1389863789, 'portfolio_id': 27892251}, {'photo_id': 1389863786, 'portfolio_id': 27892251}, {'photo_id': 1389863783, 'portfolio_id': 27892251}, {'photo_id': 1389863780, 'portfolio_id': 27892251}, {'photo_id': 1389863762, 'portfolio_id': 27892251}, {'photo_id': 1389863707, 'portfolio_id': 27892251}, {'photo_id': 1389863696, 'portfolio_id': 27892251}, {'photo_id': 1389863692, 'portfolio_id': 27892251}, {'photo_id': 1389863689, 'portfolio_id': 27892251}, {'photo_id': 1389863688, 'portfolio_id': 27892251}, {'photo_id': 1389863686, 'portfolio_id': 27892251}, {'photo_id': 1389863670, 'portfolio_id': 27892251}, {'photo_id': 1389863668, 'portfolio_id': 27892251}, {'photo_id': 1389863665, 'portfolio_id': 27892251}, {'photo_id': 1389863662, 'portfolio_id': 27892251}, {'photo_id': 1389863642, 'portfolio_id': 27892251}, {'photo_id': 1389863637, 'portfolio_id': 27892251}, {'photo_id': 1389863631, 'portfolio_id': 27892251}, {'photo_id': 1389863629, 'portfolio_id': 27892251}, {'photo_id': 1389863627, 'portfolio_id': 27892251}, {'photo_id': 1389863624, 'portfolio_id': 27892251}, {'photo_id': 1389863603, 'portfolio_id': 27892251}, {'photo_id': 1389863600, 'portfolio_id': 27892251}, {'photo_id': 1389863596, 'portfolio_id': 27892251}, {'photo_id': 1389863592, 'portfolio_id': 27892251}, {'photo_id': 1389863590, 'portfolio_id': 27892251}, {'photo_id': 1389863588, 'portfolio_id': 27892251}, {'photo_id': 1389863566, 'portfolio_id': 27892251}, {'photo_id': 1389863561, 'portfolio_id': 27892251}, {'photo_id': 1389863538, 'portfolio_id': 27892251}, {'photo_id': 1389863535, 'portfolio_id': 27892251}] map_portfolio_id_photo_id: {27892251: [1389865924, 1389865921, 1389865917, 1389865915, 1389865877, 1389865874, 1389865870, 1389865551, 1389865547, 1389864998, 1389864994, 1389864990, 1389864987, 1389864983, 1389864978, 1389864021, 1389864019, 1389864016, 1389863983, 1389863976, 1389863972, 1389863969, 1389863967, 1389863964, 1389863948, 1389863945, 1389863943, 1389863940, 1389863921, 1389863912, 1389863909, 1389863906, 1389863904, 1389863901, 1389863883, 1389863880, 1389863878, 1389863876, 1389863861, 1389863858, 1389863855, 1389863852, 1389863848, 1389863789, 1389863786, 1389863783, 1389863780, 1389863762, 1389863707, 1389863696, 1389863692, 1389863689, 1389863688, 1389863686, 1389863670, 1389863668, 1389863665, 1389863662, 1389863642, 1389863637, 1389863631, 1389863629, 1389863627, 1389863624, 1389863603, 1389863600, 1389863596, 1389863592, 1389863590, 1389863588, 1389863566, 1389863561, 1389863538, 1389863535]} ##### Call download_photos : nb_thread : 1 we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB ##### After download_photos ##### After load_data_input time to download the photos : 0.05444169044494629 #### fin chargement data Blocking on flush ? No conitnuing About to test input to load Calling datou_exec Inside datou_exec : verbose : True number of steps : 5 step1:ventilate_hashtags_in_portfolio Sat Oct 18 06:01:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec After prepare type args : select max(UNIX_TIMESTAMP(created_at)) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (27892251) Here we display some param of map_info ! map_filenames : {} map_photo_id_path_extension : {} map_subphoto_mainphoto : {} beginning of datou step ventilate_hashtags_in_portfolio : To implement ! To do loadFromThcl(), then load ParamDescType : thcl2725 get_desc_type_from_thcl : type of cat SELECT id, mtr_user_id, name, pb_hashtag_id, hashtag_id_list, button_legend_list, portfolio_id_lists, photo_hashtag_type, photo_desc_type, svm_limit, limit_tagging, is_public, live, created_at, updated_at, type_classification FROM MTRDatou.classification_theme WHERE `id` IN (2725) thcls : [{'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5186 remove imagettes from duplicated photo Iterating over portfolio : 27892251 get user id for portfolio 27892251 get sub ptf for main ptf 27892251, type 3726 and hashtags ['kraft', 'Carton_brun', 'autre_refus', 'metal', 'plastique', 'flou', 'mal_croppe', 'papier', 'Teint_Dans_La_Masse', 'environnement', 'Carton_gris', 'cartonnette'] SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27892251 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','Carton_brun','autre_refus','metal','plastique','flou','mal_croppe','papier','Teint_Dans_La_Masse','environnement','Carton_gris','cartonnette')) AND mptpi.`min_score`=0.5 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27892251 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','Carton_brun','autre_refus','metal','plastique','flou','mal_croppe','papier','Teint_Dans_La_Masse','environnement','Carton_gris','cartonnette')) AND mptpi.`min_score`=0.5 To do returned map {'Carton_brun': {'main_port_id': 27892251, 'sub_port_id': 27892257, 'hashtag': 'Carton_brun', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829868, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'Carton_gris': {'main_port_id': 27892251, 'sub_port_id': 27892258, 'hashtag': 'Carton_gris', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829869, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'papier': {'main_port_id': 27892251, 'sub_port_id': 27892259, 'hashtag': 'papier', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829870, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'flou': {'main_port_id': 27892251, 'sub_port_id': 27892260, 'hashtag': 'flou', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829871, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'kraft': {'main_port_id': 27892251, 'sub_port_id': 27892261, 'hashtag': 'kraft', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829872, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'cartonnette': {'main_port_id': 27892251, 'sub_port_id': 27892262, 'hashtag': 'cartonnette', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829873, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'mal_croppe': {'main_port_id': 27892251, 'sub_port_id': 27892263, 'hashtag': 'mal_croppe', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829874, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'plastique': {'main_port_id': 27892251, 'sub_port_id': 27892264, 'hashtag': 'plastique', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829875, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'Teint_Dans_La_Masse': {'main_port_id': 27892251, 'sub_port_id': 27892265, 'hashtag': 'Teint_Dans_La_Masse', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829876, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'environnement': {'main_port_id': 27892251, 'sub_port_id': 27892266, 'hashtag': 'environnement', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829877, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'autre_refus': {'main_port_id': 27892251, 'sub_port_id': 27892267, 'hashtag': 'autre_refus', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829878, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}, 'metal': {'main_port_id': 27892251, 'sub_port_id': 27892268, 'hashtag': 'metal', 'pht': 3726, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829879, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47)}} insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892257 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='Carton_brun' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892257) result : ((1389863928,), (1389863929,), (1389865554,), (1389865982,), (1389866046,), (1389866047,), (1389866048,), (1389866891,), (1389866892,), (1389867024,), (1389867707,), (1389867708,), (1389867709,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892258 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='Carton_gris' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892258) result : ((1389863869,), (1389863922,), (1389863923,), (1389863924,), (1389863977,), (1389863978,), (1389863979,), (1389863980,), (1389865552,), (1389865887,), (1389865979,), (1389866038,), (1389866039,), (1389866040,), (1389866041,), (1389866054,), (1389866884,), (1389866885,), (1389866886,), (1389866887,), (1389866888,), (1389866937,), (1389866938,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892259 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='papier' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892259) result : () SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892260 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='flou' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892260) result : () SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892261 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='kraft' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; Catched exception ! (1213, 'Deadlock found when trying to get lock; try restarting transaction') Connect or reconnect ! SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892261) result : ((1389863871,), (1389863872,), (1389863930,), (1389865556,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892262 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='cartonnette' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892262) result : ((1389863636,), (1389863925,), (1389863926,), (1389865980,), (1389865981,), (1389866043,), (1389866044,), (1389866889,), (1389867022,), (1389867706,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892263 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='mal_croppe' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892263) result : () SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892264 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='plastique' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892264) result : ((1389863870,), (1389863981,), (1389865555,), (1389866049,), (1389866893,), (1389866894,), (1389866895,), (1389867029,), (1389867030,), (1389867031,), (1389867711,), (1389867712,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892265 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='Teint_Dans_La_Masse' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892265) result : ((1389863634,), (1389863868,), (1389863915,), (1389863916,), (1389863917,), (1389863918,), (1389863919,), (1389863920,), (1389863975,), (1389865548,), (1389865549,), (1389866034,), (1389866035,), (1389866036,), (1389866880,), (1389866881,), (1389866882,), (1389867020,), (1389867705,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892266 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='environnement' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892266) result : () SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892267 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='autre_refus' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892267) result : ((1389863635,), (1389865550,), (1389865977,), (1389865978,), (1389866037,), (1389866883,), (1389867021,)) SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; insert ignore into MTRUser.mtr_portfolio_photos (mtr_portfolio_id, mtr_photo_id, mtr_user_id,created_at) SELECT 27892268 , sub_photo_id, 979,now() FROM (SELECT csp.sub_photo_id, csp.crop_hashtag_id, csp.created_at FROM MTRPhoto.crop_sub_photo_ids csp, MTRPhoto.crop_hashtag_ids chi, MTRBack.hashtags h, MTRUser.mtr_portfolio_photos mpp WHERE mpp.mtr_portfolio_id=27892251 AND mpp.mtr_photo_id=chi.photo_id AND chi.id=csp.crop_hashtag_id AND chi.score>0.5 AND chi.type=3726 AND chi.hashtag_id=h.hashtag_id AND h.hashtag='metal' GROUP BY csp.crop_hashtag_id, csp.created_at order by csp.created_at desc) as a group by crop_hashtag_id; SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892268) result : () SELECT mtr_photo_id FROM MTRUser.mtr_portfolio_photos WHERE mtr_portfolio_id IN (27892251) result : ((1389863535,), (1389863538,), (1389863561,), (1389863566,), (1389863588,), (1389863590,), (1389863592,), (1389863596,), (1389863600,), (1389863603,), (1389863624,), (1389863627,), (1389863629,), (1389863631,), (1389863637,), (1389863642,), (1389863662,), (1389863665,), (1389863668,), (1389863670,), (1389863686,), (1389863688,), (1389863689,), (1389863692,), (1389863696,), (1389863707,), (1389863762,), (1389863780,), (1389863783,), (1389863786,), (1389863789,), (1389863848,), (1389863852,), (1389863855,), (1389863858,), (1389863861,), (1389863876,), (1389863878,), (1389863880,), (1389863883,), (1389863901,), (1389863904,), (1389863906,), (1389863909,), (1389863912,), (1389863921,), (1389863940,), (1389863943,), (1389863945,), (1389863948,), (1389863964,), (1389863967,), (1389863969,), (1389863972,), (1389863976,), (1389863983,), (1389864016,), (1389864019,), (1389864021,), (1389864978,), (1389864983,), (1389864987,), (1389864990,), (1389864994,), (1389864998,), (1389865547,), (1389865551,), (1389865870,), (1389865874,), (1389865877,), (1389865915,), (1389865917,), (1389865921,), (1389865924,)) select distinct(cspi.sub_photo_id) from MTRPhoto.crop_hashtag_ids chi, MTRPhoto.crop_sub_photo_ids cspi where chi.type=3726 and chi.photo_id in (1389863600) and cspi.crop_hashtag_id = chi.id; To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27892251 AND mptpi.`type`=4417 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','Carton_brun','autre_refus','metal','plastique','flou','mal_croppe','papier','Teint_Dans_La_Masse','environnement','Carton_gris','cartonnette')) AND mptpi.`min_score`=0.5 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27892251 AND mptpi.`type`=4417 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','Carton_brun','autre_refus','metal','plastique','flou','mal_croppe','papier','Teint_Dans_La_Masse','environnement','Carton_gris','cartonnette')) AND mptpi.`min_score`=0.5 To do returned map {'Carton_brun': {'main_port_id': 27892251, 'sub_port_id': 27892270, 'hashtag': 'Carton_brun', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829880, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'Carton_gris': {'main_port_id': 27892251, 'sub_port_id': 27892271, 'hashtag': 'Carton_gris', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829881, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'papier': {'main_port_id': 27892251, 'sub_port_id': 27892272, 'hashtag': 'papier', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829882, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'flou': {'main_port_id': 27892251, 'sub_port_id': 27892273, 'hashtag': 'flou', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829883, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'kraft': {'main_port_id': 27892251, 'sub_port_id': 27892274, 'hashtag': 'kraft', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829884, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'cartonnette': {'main_port_id': 27892251, 'sub_port_id': 27892275, 'hashtag': 'cartonnette', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829885, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'mal_croppe': {'main_port_id': 27892251, 'sub_port_id': 27892277, 'hashtag': 'mal_croppe', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829886, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'plastique': {'main_port_id': 27892251, 'sub_port_id': 27892278, 'hashtag': 'plastique', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829887, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'Teint_Dans_La_Masse': {'main_port_id': 27892251, 'sub_port_id': 27892279, 'hashtag': 'Teint_Dans_La_Masse', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829888, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'environnement': {'main_port_id': 27892251, 'sub_port_id': 27892280, 'hashtag': 'environnement', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829889, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'autre_refus': {'main_port_id': 27892251, 'sub_port_id': 27892281, 'hashtag': 'autre_refus', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829890, 'last_updated_at': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 19, 47, 6), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}, 'metal': {'main_port_id': 27892251, 'sub_port_id': 27892282, 'hashtag': 'metal', 'pht': 4417, 'min_score': 0.5, 'mtr_user_id': 979, 'id': 18829891, 'last_updated_at': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_desc': datetime.datetime(2025, 10, 17, 20, 5, 25), 'last_updated_at_asc': datetime.datetime(2025, 10, 17, 19, 47, 6)}} insert ignore into MTRUser.mtr_portfolio_photos(mtr_portfolio_id,mtr_photo_id,mtr_user_id) select 27892270,mtr_photo_id,mtr_user_id from MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 27892257 insert ignore into MTRUser.mtr_portfolio_photos(mtr_portfolio_id,mtr_photo_id,mtr_user_id) select 27892271,mtr_photo_id,mtr_user_id from MTRUser.mtr_portfolio_photos where mtr_portfolio_id = 27892258 Catched exception ! (1213, 'Deadlock found when trying to get lock; try restarting transaction') Connect or reconnect ! ERROR in datou_step_exec, will save and exit ! (1213, 'Deadlock found when trying to get lock; try restarting transaction') File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2339, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2641, in datou_step_exec return post_process.datou_step_exec_ventilate_hashtags_in_portfolio(param, json_param, args, context, map_info, File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_post_processing.py", line 281, in datou_step_exec_ventilate_hashtags_in_portfolio context.pq.copy_portfolio(old_port_id,sub_port_id , verbose = verbose) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/portfolio_queries.py", line 538, in copy_portfolio self.gq.insert(query) File "/home/admin/workarea/git/Velours/python/mtr/database_queries/general_queries.py", line 151, in insert number = cursor.execute(query, args) File "/home/admin/.local/lib/python3.8/site-packages/MySQLdb/cursors.py", line 179, in execute res = self._query(mogrified_query) File "/home/admin/.local/lib/python3.8/site-packages/MySQLdb/cursors.py", line 330, in _query db.query(q) File "/home/admin/.local/lib/python3.8/site-packages/MySQLdb/connections.py", line 280, in query _mysql.connection.query(self, query) [1389865924, 1389865921, 1389865917, 1389865915, 1389865877, 1389865874, 1389865870, 1389865551, 1389865547, 1389864998, 1389864994, 1389864990, 1389864987, 1389864983, 1389864978, 1389864021, 1389864019, 1389864016, 1389863983, 1389863976, 1389863972, 1389863969, 1389863967, 1389863964, 1389863948, 1389863945, 1389863943, 1389863940, 1389863921, 1389863912, 1389863909, 1389863906, 1389863904, 1389863901, 1389863883, 1389863880, 1389863878, 1389863876, 1389863861, 1389863858, 1389863855, 1389863852, 1389863848, 1389863789, 1389863786, 1389863783, 1389863780, 1389863762, 1389863707, 1389863696, 1389863692, 1389863689, 1389863688, 1389863686, 1389863670, 1389863668, 1389863665, 1389863662, 1389863642, 1389863637, 1389863631, 1389863629, 1389863627, 1389863624, 1389863603, 1389863600, 1389863596, 1389863592, 1389863590, 1389863588, 1389863566, 1389863561, 1389863538, 1389863535] map_info['map_portfolio_photo'] : {27892251: [1389865924, 1389865921, 1389865917, 1389865915, 1389865877, 1389865874, 1389865870, 1389865551, 1389865547, 1389864998, 1389864994, 1389864990, 1389864987, 1389864983, 1389864978, 1389864021, 1389864019, 1389864016, 1389863983, 1389863976, 1389863972, 1389863969, 1389863967, 1389863964, 1389863948, 1389863945, 1389863943, 1389863940, 1389863921, 1389863912, 1389863909, 1389863906, 1389863904, 1389863901, 1389863883, 1389863880, 1389863878, 1389863876, 1389863861, 1389863858, 1389863855, 1389863852, 1389863848, 1389863789, 1389863786, 1389863783, 1389863780, 1389863762, 1389863707, 1389863696, 1389863692, 1389863689, 1389863688, 1389863686, 1389863670, 1389863668, 1389863665, 1389863662, 1389863642, 1389863637, 1389863631, 1389863629, 1389863627, 1389863624, 1389863603, 1389863600, 1389863596, 1389863592, 1389863590, 1389863588, 1389863566, 1389863561, 1389863538, 1389863535]} final : True mtd_id 4302 list_pids : [1389865924, 1389865921, 1389865917, 1389865915, 1389865877, 1389865874, 1389865870, 1389865551, 1389865547, 1389864998, 1389864994, 1389864990, 1389864987, 1389864983, 1389864978, 1389864021, 1389864019, 1389864016, 1389863983, 1389863976, 1389863972, 1389863969, 1389863967, 1389863964, 1389863948, 1389863945, 1389863943, 1389863940, 1389863921, 1389863912, 1389863909, 1389863906, 1389863904, 1389863901, 1389863883, 1389863880, 1389863878, 1389863876, 1389863861, 1389863858, 1389863855, 1389863852, 1389863848, 1389863789, 1389863786, 1389863783, 1389863780, 1389863762, 1389863707, 1389863696, 1389863692, 1389863689, 1389863688, 1389863686, 1389863670, 1389863668, 1389863665, 1389863662, 1389863642, 1389863637, 1389863631, 1389863629, 1389863627, 1389863624, 1389863603, 1389863600, 1389863596, 1389863592, 1389863590, 1389863588, 1389863566, 1389863561, 1389863538, 1389863535] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 74 insert ignore into MTRPhoto.mtr_datou_result (mtd_id, mtr_portfolio_id,mtr_photo_id,result,result_long,result_double,hashtag_id,proba, mtr_current_id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s) on duplicate key update mtr_portfolio_id = mtr_portfolio_id list_values : [('4302', '27892251', '1389865924', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865921', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865917', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865915', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865877', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865874', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865870', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865551', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389865547', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864998', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864994', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864990', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864987', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864983', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864978', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864021', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864019', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389864016', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863983', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863976', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863972', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863969', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863967', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863964', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863948', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863945', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863943', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863940', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863921', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863912', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863909', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863906', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863904', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863901', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863883', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863880', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863878', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863876', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863861', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863858', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863855', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863852', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863848', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863789', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863786', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863783', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863780', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863762', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863707', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863696', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863692', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863689', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863688', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863686', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863670', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863668', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863665', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863662', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863642', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863637', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863631', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863629', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863627', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863624', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863603', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863600', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863596', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863592', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863590', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863588', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863566', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863561', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863538', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019'), ('4302', '27892251', '1389863535', '[>, , , , "(1213, \'Deadlock found when trying to get lock; try restarting transaction\')"]', '-1', '-1.0', '501120777', '1.0', '3958019')] time used for this insertion : 3.58937931060791 save_final ERROR in last step ventilate_hashtags_in_portfolio, (1213, 'Deadlock found when trying to get lock; try restarting transaction') time spend for datou_step_exec : 13.670383930206299 time spend to save output : 3.592931032180786 total time spend for step 0 : 17.263314962387085 need to delete datou_research and reload, so keep current state 1 caffe_path_current : About to save ! 2 After save, about to update current ! 0.95user 0.82system 0:21.38elapsed 8%CPU (0avgtext+0avgdata 100228maxresident)k 5128inputs+248outputs (59major+48544minor)pagefaults 0swaps