o ;ήc @sfddlZddlmZmZmZmZddlZddlZee Z ddddZ GdddZ Gd d d Z dS) N)DictListTupleUnionzallenai/longformer-base-4096zallenai/longformer-large-4096z'patrickvonplaten/longformer-random-tiny)zlongformer-base-4096zlongformer-large-4096zlongformer-random-tinyc@s>eZdZddZdefddZdefddZdefdd Z d S) LongformerInputscCs||_||_||_dSN input_idsattention_maskglobal_attention_mask)selfr r r r c/tmp/pip-target-vg8gfxp4/lib/python/onnxruntime/transformers/models/longformer/longformer_helper.py__init__s zLongformerInputs.__init__returncCsdd|j|j|jfDS)NcSsg|]}|dur|qSrr .0vr r r sz,LongformerInputs.to_list..rr r r rto_listszLongformerInputs.to_listcCstdd|DS)Ncss|]}|VqdSrr rr r r !sz,LongformerInputs.to_tuple..)tuplerrr r rto_tuple szLongformerInputs.to_tuplecCs<t|jt|jt|jdS)Nr)numpyascontiguousarrayr cpur r rr r rget_ort_inputs#szLongformerInputs.get_ort_inputsN) __name__ __module__ __qualname__rrrrrrrr r r rrs rc@sfeZdZdZe ddedededejdedef d d Z ededed ede e e effd d Z dS)LongformerHelperzKA helper class for Longformer model conversion, inference and verification.d batch_sizesequence_lengthnum_global_tokensdevice vocab_sizerc Csntjd|d||ftj|d}tj|jtj|d}tj|jtj|d}tt|}d|dd|f<t|||S)zCreate random inputs for Longformer model. Returns torch tensors of input_ids, attention_mask and global_attention_mask tensors. r)lowhighsizedtyper&)r,r&N) torchrandintlongonesshapezeroslistranger) r#r$r%r&r'r r r global_token_indexr r rget_dummy_inputs.s   z!LongformerHelper.get_dummy_inputs hidden_sizecCs|||g||gdS)zAReturns a dictionary with output name as key, and shape as value.) last_statepoolerr )r#r$r7r r rget_output_shapesGsz"LongformerHelper.get_output_shapesN)r")rrr __doc__ staticmethodintr-r&rr6rstrrr:r r r rr!+s& ,r!)loggingtypingrrrrrr- getLoggerrloggerPRETRAINED_LONGFORMER_MODELSrr!r r r rs