Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What is the easiest way to make an optional C extension for a python package?

I've created a C extension that I'd like to enable in my Python package (using setuptools) only if a command line option is passed in. What is the easiest way to do this?

I can't seem to find any straightforward ways of going about this.

like image 829
Jason Baker Avatar asked Oct 30 '10 00:10

Jason Baker


People also ask

What is C extension in Python?

Any code that you write using any compiled language like C, C++, or Java can be integrated or imported into another Python script. This code is considered as an "extension." A Python extension module is nothing more than a normal C library. On Unix machines, these libraries usually end in . so (for shared object).


2 Answers

There's actually a distribute/setuptools feature called "Features" that can be used for this. It's explicitly designed to have setup.py do different things based on --with-xxx and --without-xxx command line options.

  • This blog post gives a nice introduction, I can't find any better documentation at this time (besides the Distribute source - the Feature class and features keyword).
  • The jinja project's setup.py uses Features for your exact purpose, it might be a good template to work from.
  • The simplejson setup.py also does something similar, except that it's coded to always try to build the C-extension feature it defines, and fall back gracefully to pure-python when building fails; this may also be useful for your purpose.
like image 155
Eli Collins Avatar answered Oct 16 '22 04:10

Eli Collins


ext_modules = []
if '--add-this' in sys.argv:
    ext_modules.append(Extension(...))
    sys.argv.remove('--add-this')
setup(...
      ext_modules = ext_modules
)

This is hacky, but might be easiest. A more advanced approach would be to extend the Distribution class to support a flag, say --with-modules and then customize ext_modules inside finalize_options.

like image 41
Martin v. Löwis Avatar answered Oct 16 '22 04:10

Martin v. Löwis