LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

TVNet: Temporal Voting Network for Action Localization

[ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Chenyu You, Xiaohui Xie, Zhangyang Wang

Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"

Official implementation of VaxNeRF (Voxel-Accelearated NeRF).

FairEdit: Preserving Fairness in Graph Neural Networks through Greedy Graph Editing

some academic posters as references. May we have in-person poster session soon!

PyTorch code accompanying our paper on Maximum Entropy Generators for Energy-Based Models

An Object Oriented Programming (OOP) interface for Ontology Web language (OWL) ontologies.

This repository includes code of my study about Asynchronous in Frequency domain of GAN images.

[CVPR 2022 Oral] Versatile Multi-Modal Pre-Training for Human-Centric Perception

Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation

Applying PVT to Semantic Segmentation

SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking

PyTorch-Multi-Style-Transfer - Neural Style and MSG-Net

Python Classes: Medical Insurance Project using Object Oriented Programming Concepts

GAN encoders in PyTorch that could match PGGAN, StyleGAN v1/v2, and BigGAN. Code also integrates the implementation of these GANs.

Deep Video Matting via Spatio-Temporal Alignment and Aggregation [CVPR2021]

The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"

Pytorch implementation for RelTransformer

This repository contains the code for the ICCV 2019 paper "Occupancy Flow - 4D Reconstruction by Learning Particle Dynamics"