A library for generating fake data and populating database tables.

Last update: Sep 23, 2022

Related tags

Testing knockoff-factory

Overview

Knockoff Factory

A library for generating mock data and creating database fixtures that can be used for unit testing.

Table of content

Installation
Changelog
Documentation
Unit Tests
Future Work
Legacy YAML Based CLI

Installation

pip install knockoff

Changelog

See the changelog for a history of notable changes to knockoff.

Documentation

We are working on adding more documentation and examples!

Knockoff SDK
- KnockoffTable
- KnockoffDB
TempDatabaseService
Knockoff CLI
Unit Testing Example: Sample App

Unit Tests

Prerequisites

docker
poetry (curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python)

Some of the unit tests depend on a database instance. Knockoff will create ephemeral databases within that instance and clean them up when tests have completed. By default it will attempt to connect to an existing instance at postgresql://[email protected]:5432/postgres and will create and destroy databases per test. This postgres location can be overridden with the KNOCKOFF_TEST_DB_URI environment variable.

If no external postgres instance is available for testing, but postgresql is installed, the TEST_USE_EXTERNAL_DB environment variable can be set to 0. The fixtures will then rely on the testing.postgresql library to create ephemeral postgres instances per fixture.

If postgres is not available, dependent tests can be disabled with the following: export TEST_POSTGRES_ENABLED=0.

Create the database instance using docker:

docker run --rm  --name pg-docker -e POSTGRES_HOST_AUTH_METHOD=trust -d -p 5432:5432  postgres:11.9

Install poetry:

poetry install

Run unit test:

poetry run pytest

Future work

Further documentation and examples for SDK
Add yaml based configuration for SDK
Make extensible generic output for KnockffDB.insert (csv, parquet, etc)
Enable append option for KnockoffDB.insert
Autodiscover and populate all tables by using reflection and building dependency graph with foreign key relationships
Parallelize execution of dag. (e.g. https://ipython.org/ipython-doc/stable/parallel/dag_dependencies.html)

A Python Selenium library inspired by the Testing Library

Selenium Testing Library Slenium Testing Library (STL) is a Python library for Selenium inspired by Testing-Library. Dependencies Python 3.6, 3.7, 3.8

12 Dec 26, 2022

A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax

1.0 Release See here for details about breaking changes with the upcoming 1.0 release: https://github.com/taverntesting/tavern/issues/495 Easier API t

909 Dec 15, 2022

Test django schema and data migrations, including migrations' order and best practices.

django-test-migrations Features Allows to test django schema and data migrations Allows to test both forward and rollback migrations Allows to test th

382 Dec 27, 2022

Hypothesis is a powerful, flexible, and easy to use library for property-based testing.

Hypothesis Hypothesis is a family of testing libraries which let you write tests parametrized by a source of examples. A Hypothesis implementation the

6.4k Jan 5, 2023

Python version of the Playwright testing and automation library.

🎭 Playwright for Python Docs | API Playwright is a Python library to automate Chromium, Firefox and WebKit browsers with a single API. Playwright del

7.8k Jan 2, 2023

A library to make concurrent selenium tests that automatically download and setup webdrivers

AutoParaSelenium A library to make parallel selenium tests that automatically download and setup webdrivers Usage Installation pip install autoparasel

8 Mar 13, 2022

pytest plugin for manipulating test data directories and files

pytest-datadir pytest plugin for manipulating test data directories and files. Usage pytest-datadir will look up for a directory with the name of your

191 Dec 21, 2022

A mocking library for requests

httmock A mocking library for requests for Python 2.7 and 3.4+. Installation pip install httmock Or, if you are a Gentoo user: emerge dev-python/httm

452 Dec 28, 2022

A utility for mocking out the Python Requests library.

Responses A utility library for mocking out the requests Python library. Note Responses requires Python 2.7 or newer, and requests = 2.0 Installing p

3.8k Jan 3, 2023

Releases(v4.3.2)

v4.3.2(Aug 3, 2022)
Removed dependency on six which was required for py23 compatibility.

Updated dependency-injector version to resolve poetry lock issue with six <=1.15.0.

Additional information about the changes can be found here.
Source code(tar.gz)
Source code(zip)
v4.3.1(Aug 3, 2022)

Fixed backwards compatibility issue in KnockoffContainer with sqlalchemy breaking change for create_engine's positional arg changing into a kwarg, url. Fix KnockoffDB class so that it actually skips inserts where insert=False for a node Fix KnockoffTableFactory so that if you pass next_strategy_factory it won't complain about also providing next_strategy_callable

Additional information about the changes can be found here.
Source code(tar.gz)
Source code(zip)
v4.3.0(Jul 27, 2021)
Added io utilities for parallelizing writes to sql with joblib

Added rename and drop parameters for KnockoffTable

Added support for MySQL to TempDatabaseService (knockoff.tempdb.setup_teardown:mysql_setup_teardown)

Added reflect_schema method to KnockoffDatabaseService

Moved knockoff.testing_postgresql modules to knockoff.utilities.testing.postgresql

Parallelized DefaultDatabaseService inserts

Renamed KnockoffTable.build_record method to KnockoffTable._build_record declaring it as private by convention

Fixed DefaultDatabaseService's reflect_table method for MySql

Additional information about changes can be found here.
Source code(tar.gz)
Source code(zip)
v4.2.1(Jul 27, 2021)
Added default configurations for knockoff run CLI with environment variable override options

Moved clear_env_vars from knockoff.orm to knockoff.utilities.environ

Fixed issue where knockoff run CLI was not using the temp db created with the --ephemeral flag

Source code(tar.gz)
Source code(zip)
v4.2.0(Jul 19, 2021)
Add --ephemeral flag for knockoff run CLI to create temp database for loading knockoff configuration from sdk

Add unit tests for KnockoffDB.build and knockoff run CLI

Add Documentation and jupyter notebook for TempDatabaseService

Add Documentation and jupyter notebook for KnockoffDB

Moved legacy YAML based knockoff cli from README.md to legacy.MD

Source code(tar.gz)
Source code(zip)
v4.1.0(Jul 19, 2021)
Add CollectionsFactory for providing factory functions that return multiple columns

Documentation and jupyter notebook for KnockoffTable

Source code(tar.gz)
Source code(zip)
v4.0.0(Jul 15, 2021)
Added ColumnFactory for providing factory functions instead of requiring as a tuple (column, factory)

Added build method for KnockoffDB to enable building dataframes without inserting into DB

Added run CLI command for loading data into database from sdk configuration

Added Blueprint class to sdk for more composable configuration

Added tempdb module and TempDatabaseService class

Made CLI extensible with injectable subcommands

Moved previous CLI to legacy subcommand for loading data into database using yaml configuration

Renamed knockoff.utilities.mixin:FactoryMixin to knockoff.utilities.mixin:ResourceLocatorMixin

Updated internal knockoff fixtures to use TempDatabaseService

Additional changes can be found here.
Source code(tar.gz)
Source code(zip)

Owner

Nike Inc.

GitHub Repository

Fully functioning price detector built with selenium and python

4 Mar 30, 2022

Testing Calculations in Python, using OOP (Object-Oriented Programming)

Testing Calculations in Python, using OOP (Object-Oriented Programming) Create environment with venv python3 -m venv venv Activate environment . venv

1 Nov 11, 2021

Ward is a modern test framework for Python with a focus on productivity and readability.

1k Dec 31, 2022

This repository contnains sample problems with test cases using Cormen-Lib

Cormen Lib Sample Problems Description This repository contnains sample problems with test cases using Cormen-Lib. These problems were made for the pu

3 Jun 30, 2022

Code for "SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism"

SUGAR Code for "SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism" Overview train.py: the cor

41 Nov 08, 2022

HTTP traffic mocking and testing made easy in Python

pook Versatile, expressive and hackable utility library for HTTP traffic mocking and expectations made easy in Python. Heavily inspired by gock. To ge

305 Dec 23, 2022

API mocking with Python.

apyr apyr (all lowercase) is a simple & easy to use mock API server. It's great for front-end development when your API is not ready, or when you are

55 Nov 25, 2022

This file will contain a series of Python functions that use the Selenium library to search for elements in a web page while logging everything into a file

element_search with Selenium (Now With docstrings 😎 ) Just to mention, I'm a beginner to all this, so it it's very possible to make some mistakes The

2 Aug 12, 2021

Python Projects - Few Python projects with Testing using Pytest

Python_Projects Few Python projects : Fast_API_Docker_PyTest- Just a simple auto

1 Jan 22, 2022

Language-agnostic HTTP API Testing Tool

Dredd — HTTP API Testing Framework Dredd is a language-agnostic command-line tool for validating API description document against backend implementati

4k Jan 05, 2023

This package is a python library with tools for the Molecular Simulation - Software Gromos.

This package is a python library with tools for the Molecular Simulation - Software Gromos. It allows you to easily set up, manage and analyze simulations in python.

14 Sep 28, 2022

WrightEagle AutoTest (Has been updated by Cyrus team members)

Autotest2d WrightEagle AutoTest (Has been updated by Cyrus team members) Thanks go to WrightEagle Members. Steps 1- prepare start_team file. In this s

3 Sep 01, 2022

1st Solution to QQ Browser 2021 AIAC Track 2

1st Solution to QQ Browser 2021 AIAC Track 2 This repository is the winning solution to QQ Browser 2021 AI Algorithm Competition Track 2 Automated Hyp

24 Sep 10, 2022

a plugin for py.test that changes the default look and feel of py.test (e.g. progressbar, show tests that fail instantly)

pytest-sugar pytest-sugar is a plugin for pytest that shows failures and errors instantly and shows a progress bar. Requirements You will need the fol

963 Dec 28, 2022

Mockoon is the easiest and quickest way to run mock APIs locally. No remote deployment, no account required, open source.

Mockoon Mockoon is the easiest and quickest way to run mock APIs locally. No remote deployment, no account required, open source. It has been built wi

4.4k Dec 30, 2022