3 ` @sddlZddlZddlZddlZddlZddlZddlZddlmZej e Z e j ej e jejejdZedejdddZdd Zd d Zd d ZdS)N) BertTokenizer@zLoading BERT tokenizer...zbert-base-uncasedT) do_lower_casecCsVtjtjjrdnd}tdttj|tjjtj j |d}td|j |S)Ncudacpuz=================== objects in model_dir =====================ztraced_bert.ptz=================== model loaded =============================) torchdevicer is_availableprintoslistdirjitloadpathjointo) model_dirrZ loaded_modelr)rloggingr sysrtorch.utils.dataZtorch.utils.data.distributed transformersr getLogger__name__loggersetLevelDEBUG addHandler StreamHandlerstdoutr$r from_pretrainedr"rr3r>rrrrs     #