config – Theano Configuration

Guide

The config module contains many attributes that modify Theano’s behavior. Many of these attributes are consulted during the import of the theano module and many are assumed to be read-only.

As a rule, the attributes in this module should not be modified by user code.

Theano’s code comes with default values for these attributes, but you can override them from your .theanorc file, and override those values in turn by the THEANO_FLAGS environment variable.

The order of precedence is:

  1. an assignment to theano.config.<property>

  2. an assignment in THEANO_FLAGS

  3. an assignment in the .theanorc file (or the file indicated in THEANORC)

You can print out the current/effective configuration at any time by printing theano.config. For example, to see a list of all active configuration variables, type this from the command-line:

python -c 'import theano; print(theano.config)' | less

Environment Variables

THEANO_FLAGS

This is a list of comma-delimited key=value pairs that control Theano’s behavior.

For example, in bash, you can override your THEANORC defaults for <myscript>.py by typing this:

THEANO_FLAGS='floatX=float32,device=cuda0,gpuarray.preallocate=1'  python <myscript>.py

If a value is defined several times in THEANO_FLAGS, the right-most definition is used. So, for instance, if THEANO_FLAGS='device=cpu,device=cuda0', then cuda0 will be used.

THEANORC

The location[s] of the .theanorc file[s] in ConfigParser format. It defaults to $HOME/.theanorc. On Windows, it defaults to $HOME/.theanorc:$HOME/.theanorc.txt to make Windows users’ life easier.

Here is the .theanorc equivalent to the THEANO_FLAGS in the example above:

[global]
floatX = float32
device = cuda0

[gpuarray]
preallocate = 1

Configuration attributes that are available directly in config (e.g. config.device, config.mode) should be defined in the [global] section. Attributes from a subsection of config (e.g. config.gpuarray.preallocate, config.dnn.conv.algo_fwd) should be defined in their corresponding section (e.g. [gpuarray], [dnn.conv]).

Multiple configuration files can be specified by separating them with ‘:’ characters (as in $PATH). Multiple configuration files will be merged, with later (right-most) files taking priority over earlier files in the case that multiple files specify values for a common configuration option. For example, to override system-wide settings with personal ones, set THEANORC=/etc/theanorc:~/.theanorc. To load configuration files in the current working directory, append .theanorc to the list of configuration files, e.g. THEANORC=~/.theanorc:.theanorc.

Config Attributes

The list below describes some of the more common and important flags that you might want to use. For the complete list (including documentation), import theano and print the config variable, as in:

python -c 'import theano; print(theano.config)' | less
config.device[source]

String value: either 'cpu', 'cuda', 'cuda0', 'cuda1', 'opencl0:0', 'opencl0:1', …

Default device for computations. If 'cuda*, change the default to try to move computation to the GPU using CUDA libraries. If 'opencl*', the OpenCL libraries will be used. To let the driver select the device, use 'cuda' or 'opencl'. If we are not able to use the GPU, either we fall back on the CPU, or an error is raised, depending on the force_device flag.

This flag’s value cannot be modified during the program execution.

Do not use upper case letters, only lower case even if NVIDIA uses capital letters.

config.force_device[source]

Bool value: either True or False

Default: False

If True and device=gpu*, we raise an error if we cannot use the specified device. If True and device=cpu, we disable the GPU. If False and device=gpu*, and if the specified device cannot be used, we warn and fall back to the CPU.

This is useful to run Theano’s tests on a computer with a GPU, but without running the GPU tests.

This flag’s value cannot be modified during the program execution.

config.init_gpu_device[source]

String value: either '', 'cuda', 'cuda0', 'cuda1', 'opencl0:0', 'opencl0:1', …

Initialize the gpu device to use. When its value is 'cuda*' or 'opencl*', the theano flag device must be 'cpu'. Unlike device, setting this flag to a specific GPU will not try to use this device by default, in particular it will not move computations, nor shared variables, to the specified GPU.

This flag is useful to run GPU-specific tests on a particular GPU, instead of using the default one.

This flag’s value cannot be modified during the program execution.

config.print_active_device[source]

Bool value: either True or False

Default: True

Print active device at when the GPU device is initialized.

config.floatX[source]

String value: 'float64', 'float32', or 'float16' (with limited support)

Default: 'float64'

This sets the default dtype returned by tensor.matrix(), tensor.vector(), and similar functions. It also sets the default Theano bit width for arguments passed as Python floating-point numbers.

config.warn_float64[source]

String value: either 'ignore', 'warn', 'raise', or 'pdb'

Default: 'ignore'

When creating a TensorVariable with dtype float64, what should be done? This is useful to help find upcast to float64 in user code.

config.deterministic[source]

String value: either 'default', 'more'

Default: 'default'

If more, sometimes we will select some implementation that are more deterministic, but slower. In particular, on the GPU, we will avoid using AtomicAdd. Sometimes we will still use non-deterministic implementaion, e.g. when we do not have a GPU implementation that is deterministic. Also see the dnn.conv.algo* flags to cover more cases.

config.allow_gc[source]

Bool value: either True or False

Default: True

This sets the default for the use of the Theano garbage collector for intermediate results. To use less memory, Theano frees the intermediate results as soon as they are no longer needed. Disabling Theano garbage collection allows Theano to reuse buffers for intermediate results between function calls. This speeds up Theano by no longer spending time reallocating space. This gives significant speed up on functions with many ops that are fast to execute, but this increases Theano’s memory usage.

Note

if config.gpuarray.preallocate is the default value or not disabled (-1), this is not useful anymore on the GPU.

config.scan.allow_output_prealloc[source]

Bool value, either True or False

Default: True

This enables, or not, an optimization in Scan in which it tries to pre-allocate memory for its outputs. Enabling the optimization can give a significant speed up with Scan at the cost of slightly increased memory usage.

config.scan.allow_gc[source]

Bool value, either True or False

Default: False

Allow/disallow gc inside of Scan.

If config.allow_gc is True, but config.scan.allow_gc is False, then we will gc the inner of scan after all iterations. This is the default.

config.scan.debug[source]

Bool value, either True or False

Default: False

If True, we will print extra scan debug information.

config.cycle_detection[source]

String value, either regular or fast`

Default: regular

If cycle_detection is set to regular, most inplaces are allowed, but it is slower. If cycle_detection is set to faster, less inplaces are allowed, but it makes the compilation faster.

The interaction of which one give the lower peak memory usage is complicated and not predictable, so if you are close to the peak memory usage, trying both could give you a small gain.

config.check_stack_trace[source]

String value, either off, log, warn, raise

Default: off

This is a flag for checking the stack trace during the optimization process. If check_stack_trace is set to off, no check is performed on the stack trace. If check_stack_trace is set to log or warn, a dummy stack trace is inserted that indicates which optimization inserted the variable that had an empty stack trace but, in warn a warning is also printed. If check_stack_trace is set to raise, an exception is raised if a stack trace is missing.

config.openmp[source]

Bool value: either True or False

Default: False

Enable or disable parallel computation on the CPU with OpenMP. It is the default value used when creating an Op that supports it. It is best to define it in .theanorc or in the environment variable THEANO_FLAGS.

config.openmp_elemwise_minsize[source]

Positive int value, default: 200000.

This specifies the vectors minimum size for which elemwise ops use openmp, if openmp is enabled.

config.cast_policy[source]

String value: either 'numpy+floatX' or 'custom'

Default: 'custom'

This specifies how data types are implicitly figured out in Theano, e.g. for constants or in the results of arithmetic operations. The ‘custom’ value corresponds to a set of custom rules originally used in Theano (which can be partially customized, see e.g. the in-code help of tensor.NumpyAutocaster), and will be deprecated in the future. The ‘numpy+floatX’ setting attempts to mimic the numpy casting rules, although it prefers to use float32 numbers instead of float64 when config.floatX is set to ‘float32’ and the user uses data that is not explicitly typed as float64 (e.g. regular Python floats). Note that ‘numpy+floatX’ is not currently behaving exactly as planned (it is a work-in-progress), and thus you should consider it as experimental. At the moment it behaves differently from numpy in the following situations:

  • Depending on the value of config.int_division, the resulting type of a division of integer types with the / operator may not match that of numpy.

  • On mixed scalar / array operations, numpy tries to prevent the scalar from upcasting the array’s type unless it is of a fundamentally different type. Theano does not attempt to do the same at this point, so you should be careful that scalars may upcast arrays when they would not when using numpy. This behavior should change in the near future.

config.int_division[source]

String value: either 'int', 'floatX', or 'raise'

Default: 'int'

Specifies what to do when one tries to compute x / y, where both x and y are of integer types (possibly unsigned). ‘int’ means an integer is returned (as in Python 2.X), but this behavior is deprecated. ‘floatX’ returns a number of type given by config.floatX. ‘raise’ is the safest choice (and will become default in a future release of Theano) and raises an error when one tries to do such an operation, enforcing the use of the integer division operator (//) (if a float result is intended, either cast one of the arguments to a float, or use x.__truediv__(y)).

config.mode[source]

String value: 'Mode', 'DebugMode', 'FAST_RUN', 'FAST_COMPILE'

Default: 'Mode'

This sets the default compilation mode for theano functions. By default the mode Mode is equivalent to FAST_RUN. See Config attribute linker and optimizer.

config.profile[source]

Bool value: either True or False

Default: False

Do the vm/cvm linkers profile the execution time of Theano functions?

See Profiling Theano function for examples.

config.profile_memory[source]

Bool value: either True or False

Default: False

Do the vm/cvm linkers profile the memory usage of Theano functions? It only works when profile=True.

config.profile_optimizer[source]

Bool value: either True or False

Default: False

Do the vm/cvm linkers profile the optimization phase when compiling a Theano function? It only works when profile=True.

config.profiling.n_apply[source]

Positive int value, default: 20.

The number of Apply nodes to print in the profiler output

config.profiling.n_ops[source]

Positive int value, default: 20.

The number of Ops to print in the profiler output

config.profiling.min_memory_size[source]

Positive int value, default: 1024.

For the memory profile, do not print Apply nodes if the size of their outputs (in bytes) is lower than this.

config.profiling.min_peak_memory[source]

Bool value: either True or False

Default: False

Does the memory profile print the min peak memory usage? It only works when profile=True, profile_memory=True

config.profiling.destination[source]

String value: 'stderr', 'stdout', or a name of a file to be created

Default: 'stderr'

Name of the destination file for the profiling output. The profiling output can be either directed to stderr (default), or stdout or an arbitrary file.

config.profiling.debugprint[source]

Bool value: either True or False

Default: False

Do a debugprint of the profiled functions

config.profiling.ignore_first_call[source]

Bool value: either True or False

Default: False

Do we ignore the first call to a Theano function while profiling.

config.lib.amdlibm[source]

Bool value: either True or False

Default: False

This makes the compilation use the amdlibm library, which is faster than the standard libm.

config.gpuarray.preallocate[source]

Float value

Default: 0 (Preallocation of size 0, only cache the allocation)

Controls the preallocation of memory with the gpuarray backend.

The value represents the start size (either in MB or the fraction of total GPU memory) of the memory pool. If more memory is needed, Theano will try to obtain more, but this can cause memory fragmentation.

A negative value will completely disable the allocation cache. This can have a severe impact on performance and so should not be done outside of debugging.

  • < 0: disabled

  • 0 <= N <= 1: use this fraction of the total GPU memory (clipped to .95 for driver memory).

  • > 1: use this number in megabytes (MB) of memory.

Note

This could cause memory fragmentation. So if you have a memory error while using the cache, try to allocate more memory at the start or disable it. If you try this, report your result on theano-dev.

Note

The clipping at 95% can be bypassed by specifying the exact number of megabytes. If more then 95% are needed, it will try automatically to get more memory. But this can cause fragmentation, see note above.

config.gpuarray.sched[source]

String value: 'default', 'multi', 'single'

Default: 'default'

Control the stream mode of contexts.

The sched parameter passed for context creation to pygpu. With CUDA, using “multi” mean using the parameter cudaDeviceScheduleBlockingSync. This is useful to lower the CPU overhead when waiting for GPU. One user found that it speeds up his other processes that was doing data augmentation.

config.gpuarray.single_stream[source]

Boolean value

Default: True

Control the stream mode of contexts.

If your computations are mostly lots of small elements, using single-stream will avoid the synchronization overhead and usually be faster. For larger elements it does not make a difference yet. In the future when true multi-stream is enabled in libgpuarray, this may change. If you want to make sure to have optimal performance, check both options.

config.gpuarray.cache_path[source]

Default: config.compiledir/gpuarray_kernels

Directory to cache pre-compiled kernels for the gpuarray backend.

config.linker[source]

String value: 'c|py', 'py', 'c', 'c|py_nogc'

Default: 'c|py'

When the mode is Mode, it sets the default linker used. See Configuration Settings and Compiling Modes for a comparison of the different linkers.

config.optimizer[source]

String value: 'fast_run', 'merge', 'fast_compile', 'None'

Default: 'fast_run'

When the mode is Mode, it sets the default optimizer used.

config.on_opt_error[source]

String value: 'warn', 'raise', 'pdb' or 'ignore'

Default: 'warn'

When a crash occurs while trying to apply some optimization, either warn the user and skip this optimization (‘warn’), raise the exception (‘raise’), fall into the pdb debugger (‘pdb’) or ignore it (‘ignore’). We suggest to never use ‘ignore’ except in tests.

If you encounter a warning, report it on theano-dev.

config.assert_no_cpu_op[source]

String value: 'ignore' or 'warn' or 'raise' or 'pdb'

Default: 'ignore'

If there is a CPU op in the computational graph, depending on its value; this flag can either raise a warning, an exception or stop the compilation with pdb.

config.on_shape_error[source]

String value: 'warn' or 'raise'

Default: 'warn'

When an exception is raised when inferring the shape of some apply node, either warn the user and use a default value (‘warn’), or raise the exception (‘raise’).

config.warn.ignore_bug_before[source]

String value: 'None', 'all', '0.3', '0.4', '0.4.1', '0.5', '0.6', '0.7', '0.8', '0.8.1', '0.8.2', '0.9', '0.10', '1.0', '1.0.1', '1.0.2', '1.0.3', '1.0.4'

Default: '0.9'

When we fix a Theano bug that generated bad results under some circumstances, we also make Theano raise a warning when it encounters the same circumstances again. This helps to detect if said bug had affected your past experiments, as you only need to run your experiment again with the new version, and you do not have to understand the Theano internal that triggered the bug. A better way to detect this will be implemented. See this ticket.

This flag allows new users not to get warnings about old bugs, that were fixed before their first checkout of Theano. You can set its value to the first version of Theano that you used (probably 0.3 or higher)

'None' means that all warnings will be displayed. 'all' means all warnings will be ignored.

It is recommended that you put a version, so that you will see future warnings. It is also recommended you put this into your .theanorc, so this setting will always be used.

This flag’s value cannot be modified during the program execution.

config.base_compiledir[source]

Default: On Windows: $LOCALAPPDATA\Theano if $LOCALAPPDATA is defined, otherwise and on other systems: ~/.theano.

This directory stores the platform-dependent compilation directories.

This flag’s value cannot be modified during the program execution.

config.compiledir_format[source]

Default: "compiledir_%(platform)s-%(processor)s-%(python_version)s-%(python_bitwidth)s"

This is a Python format string that specifies the subdirectory of config.base_compiledir in which to store platform-dependent compiled modules. To see a list of all available substitution keys, run python -c "import theano; print(theano.config)", and look for compiledir_format.

This flag’s value cannot be modified during the program execution.

config.compiledir[source]

Default: config.base_compiledir/config.compiledir_format

This directory stores dynamically-compiled modules for a particular platform.

This flag’s value cannot be modified during the program execution.

config.blas.ldflags[source]

Default: '-lblas'

Link arguments to link against a (Fortran) level-3 blas implementation. The default will test if '-lblas' works. If not, we will disable our C code for BLAS.

config.experimental.local_alloc_elemwise_assert[source]

Bool value: either True or False

Default: True

When the local_alloc_optimization is applied, add an assert to highlight shape errors.

Without such asserts this optimization could hide errors in the user code. We add the assert only if we can’t infer that the shapes are equivalent. As such this optimization does not always introduce an assert in the graph. Removing the assert could speed up execution.

config.dnn.enabled[source]

String value: 'auto', 'True', 'False'

Default: 'auto'

If 'auto', automatically detect and use cuDNN if it is available. If cuDNN is unavailable, raise no error.

If 'True', require the use of cuDNN. If cuDNN is unavailable, raise an error.

If 'False', do not use cuDNN or check if it is available.

If 'no_check', assume present and the version between header and library match (so less compilation at context init)”,

config.dnn.include_path[source]

Default: include sub-folder in CUDA root directory, or headers paths defined for the compiler.

Location of the cudnn header.

config.dnn.library_path[source]

Default: Library sub-folder (lib64 on Linux) in CUDA root directory, or libraries paths defined for the compiler.

Location of the cudnn library.

config.conv.assert_shape[source]

If True, AbstractConv* ops will verify that user-provided shapes match the runtime shapes (debugging option, may slow down compilation)

config.dnn.conv.workmem[source]

Deprecated, use config.dnn.conv.algo_fwd.

config.dnn.conv.workmem_bwd[source]

Deprecated, use config.dnn.conv.algo_bwd_filter and config.dnn.conv.algo_bwd_data instead.

config.dnn.conv.algo_fwd[source]

String value: 'small', 'none', 'large', 'fft', 'fft_tiling', 'winograd', 'winograd_non_fused', 'guess_once', 'guess_on_shape_change', 'time_once', 'time_on_shape_change'.

Default: 'small'

3d convolution only support 'none', 'small', 'fft_tiling', 'guess_once', 'guess_on_shape_change', 'time_once', 'time_on_shape_change'.

config.dnn.conv.algo_bwd[source]

Deprecated, use config.dnn.conv.algo_bwd_filter and config.dnn.conv.algo_bwd_data instead.

config.dnn.conv.algo_bwd_filter[source]

String value: 'none', 'deterministic', 'fft', 'small', 'winograd_non_fused', 'fft_tiling', 'guess_once', 'guess_on_shape_change', 'time_once', 'time_on_shape_change'.

Default: 'none'

3d convolution only supports 'none', 'small', 'guess_once', 'guess_on_shape_change', 'time_once', 'time_on_shape_change'.

config.dnn.conv.algo_bwd_data[source]

String value: 'none', 'deterministic', 'fft', 'fft_tiling', 'winograd', 'winograd_non_fused', 'guess_once', 'guess_on_shape_change', 'time_once', 'time_on_shape_change'.

Default: 'none'

3d convolution only support 'none', 'deterministic', 'fft_tiling' 'guess_once', 'guess_on_shape_change', 'time_once', 'time_on_shape_change'.

config.magma.enabled[source]

String value: 'True', 'False'

Default: 'False'

If 'True', use magma for matrix computations.

If 'False', disable magma.

config.magma.include_path[source]

Default: ''

Location of the magma headers.

config.magma.library_path[source]

Default: ''

Location of the magma library.

config.ctc.root[source]

Default: ''

Location of the warp-ctc folder. The folder should contain either a build, lib or lib64 subfolder with the shared library (libwarpctc.so), and another subfolder called include, with the CTC library header.

config.gcc.cxxflags[source]

Default: ""

Extra parameters to pass to gcc when compiling. Extra include paths, library paths, configuration options, etc.

config.cxx[source]

Default: Full path to g++ if g++ is present. Empty string otherwise.

Indicates which C++ compiler to use. If empty, no C++ code is compiled. Theano automatically detects whether g++ is present and disables C++ compilation when it is not. On darwin systems (Mac OS X), it preferably looks for clang++ and uses that if available.

We print a warning if we detect that no compiler is present. It is recommended to run with C++ compilation as Theano will be much slower otherwise.

This can be any compiler binary (full path or not) but things may break if the interface is not g++-compatible to some degree.

config.optimizer_excluding[source]

Default: ""

A list of optimizer tags that we don’t want included in the default Mode. If multiple tags, separate them by ‘:’. Ex: to remove the elemwise inplace optimizer(slow for big graph), use the flags: optimizer_excluding:inplace_opt, where inplace_opt is the name of that optimization.

This flag’s value cannot be modified during the program execution.

config.optimizer_including[source]

Default: ""

A list of optimizer tags that we want included in the default Mode. If multiple tags, separate them by ‘:’.

This flag’s value cannot be modified during the program execution.

config.optimizer_requiring[source]

Default: ""

A list of optimizer tags that we require for optimizer in the default Mode. If multiple tags, separate them by ‘:’.

This flag’s value cannot be modified during the program execution.

config.optimizer_verbose[source]

Bool value: either True or False

Default: False

When True, we print on the stdout the optimization applied.

config.nocleanup[source]

Bool value: either True or False

Default: False

If False, source code files are removed when they are not needed anymore. This means files whose compilation failed are deleted. Set to True to keep those files in order to debug compilation errors.

config.compile[source]

This section contains attributes which influence the compilation of C code for ops. Due to historical reasons many attributes outside of this section also have an influence over compilation, most notably ‘cxx’. This is not expected to change any time soon.

config.compile.timeout[source]

Positive int value, default: compile.wait * 24

Time to wait before an unrefreshed lock is broken and stolen. This is in place to avoid manual cleanup of locks in case a process crashed and left a lock in place.

The refresh time is automatically set to half the timeout value.

config.compile.wait[source]

Positive int value, default: 5

Time to wait between attempts at grabbing the lock if the first attempt is not successful. The actual time will be between compile.wait and compile.wait * 2 to avoid a crowding effect on lock.

config.DebugMode[source]

This section contains various attributes configuring the behaviour of mode DebugMode. See directly this section for the documentation of more configuration options.

config.DebugMode.check_preallocated_output[source]

Default: ''

A list of kinds of preallocated memory to use as output buffers for each Op’s computations, separated by :. Implemented modes are:

  • "initial": initial storage present in storage map (for instance, it can happen in the inner function of Scan),

  • "previous": reuse previously-returned memory,

  • "c_contiguous": newly-allocated C-contiguous memory,

  • "f_contiguous": newly-allocated Fortran-contiguous memory,

  • "strided": non-contiguous memory with various stride patterns,

  • "wrong_size": memory with bigger or smaller dimensions,

  • "ALL": placeholder for all of the above.

In order not to test with preallocated memory, use an empty string, "".

config.DebugMode.check_preallocated_output_ndim[source]

Positive int value, default: 4.

When testing with “strided” preallocated output memory, test all combinations of strides over that number of (inner-most) dimensions. You may want to reduce that number to reduce memory or time usage, but it is advised to keep a minimum of 2.

config.DebugMode.warn_input_not_reused[source]

Bool value, default: True

Generate a warning when the destroy_map or view_map tell that an op work inplace, but the op did not reuse the input for its output.

config.NanGuardMode.nan_is_error[source]

Bool value, default: True

Controls whether NanGuardMode generates an error when it sees a nan.

config.NanGuardMode.inf_is_error[source]

Bool value, default: True

Controls whether NanGuardMode generates an error when it sees an inf.

config.NanGuardMode.big_is_error[source]

Bool value, default: True

Controls whether NanGuardMode generates an error when it sees a big value (>1e10).

config.numpy[source]

This section contains different attributes for configuring NumPy’s behaviour, described by numpy.seterr.

config.numpy.seterr_all[source]

String Value: 'ignore', 'warn', 'raise', 'call', 'print', 'log', 'None'

Default: 'ignore'

Set the default behaviour described by numpy.seterr.

'None' means that numpy’s default behaviour will not be changed (unless one of the other config.numpy.seterr_* overrides it), but this behaviour can change between numpy releases.

This flag sets the default behaviour for all kinds of floating-point errors, and it can be overridden for specific errors by setting one (or more) of the flags below.

This flag’s value cannot be modified during the program execution.

config.numpy.seterr_divide[source]

String Value: 'None', 'ignore', 'warn', 'raise', 'call', 'print', 'log'

Default: 'None'

Sets numpy’s behavior for division by zero. 'None' means using the default, defined by config.numpy.seterr_all.

This flag’s value cannot be modified during the program execution.

config.numpy.seterr_over[source]

String Value: 'None', 'ignore', 'warn', 'raise', 'call', 'print', 'log'

Default: 'None'

Sets numpy’s behavior for floating-point overflow. 'None' means using the default, defined by config.numpy.seterr_all.

This flag’s value cannot be modified during the program execution.

config.numpy.seterr_under[source]

String Value: 'None', 'ignore', 'warn', 'raise', 'call', 'print', 'log'

Default: 'None'

Sets numpy’s behavior for floating-point underflow. 'None' means using the default, defined by config.numpy.seterr_all.

This flag’s value cannot be modified during the program execution.

config.numpy.seterr_invalid[source]

String Value: 'None', 'ignore', 'warn', 'raise', 'call', 'print', 'log'

Default: 'None'

Sets numpy’s behavior for invalid floating-point operation. 'None' means using the default, defined by config.numpy.seterr_all.

This flag’s value cannot be modified during the program execution.

config.compute_test_value[source]

String Value: 'off', 'ignore', 'warn', 'raise'.

Default: 'off'

Setting this attribute to something other than 'off' activates a debugging mechanism, where Theano executes the graph on-the-fly, as it is being built. This allows the user to spot errors early on (such as dimension mis-match), before optimizations are applied.

Theano will execute the graph using the Constants and/or shared variables provided by the user. Purely symbolic variables (e.g. x = T.dmatrix()) can be augmented with test values, by writing to their 'tag.test_value' attribute (e.g. x.tag.test_value = numpy.random.rand(5, 4)).

When not 'off', the value of this option dictates what happens when an Op’s inputs do not provide appropriate test values:

  • 'ignore' will silently skip the debug mechanism for this Op

  • 'warn' will raise a UserWarning and skip the debug mechanism for this Op

  • 'raise' will raise an Exception

config.compute_test_value_opt[source]

As compute_test_value, but it is the value used during Theano optimization phase. Theano user’s do not need to use this. This is to help debug shape error in Theano optimization.

config.print_test_value[source]

Bool value, default: False

If 'True', Theano will override the __str__ method of its variables to also print the tag.test_value when this is available.

config.reoptimize_unpickled_function[source]

Bool value, default: False (changed in master after Theano 0.7 release)

Theano users can use the standard python pickle tools to save a compiled theano function. When pickling, both graph before and after the optimization are saved, including shared variables. When set to True, the graph is reoptimized when being unpickled. Otherwise, skip the graph optimization and use directly the optimized graph.

config.exception_verbosity[source]

String Value: 'low', 'high'.

Default: 'low'

If 'low', the text of exceptions will generally refer to apply nodes with short names such as 'Elemwise{add_no_inplace}'. If 'high', some exceptions will also refer to apply nodes with long descriptions like:

A. Elemwise{add_no_inplace}
      B. log_likelihood_v_given_h
      C. log_likelihood_h
config.cmodule.warn_no_version[source]

Bool value, default: False

If True, will print a warning when compiling one or more Op with C code that can’t be cached because there is no c_code_cache_version() function associated to at least one of those Ops.

config.cmodule.remove_gxx_opt[source]

Bool value, default: False

If True, will remove the -O* parameter passed to g++. This is useful to debug in gdb modules compiled by Theano. The parameter -g is passed by default to g++.

config.cmodule.compilation_warning[source]

Bool value, default: False

If True, will print compilation warnings.

config.cmodule.preload_cache[source]

Bool value, default: False

If set to True, will preload the C module cache at import time

config.cmodule.age_thresh_use[source]

Int value, default: 60 * 60 * 24 * 24 # 24 days

In seconds. The time after which a compiled c module won’t be reused by Theano. Automatic deletion of those c module 7 days after that time.

config.cmodule.debug[source]

Bool value, default: False

If True, define a DEBUG macro (if not exists) for any compiled C code.

config.traceback.limit[source]

Int value, default: 8

The number of user stack level to keep for variables.

config.traceback.compile_limit[source]

Bool value, default: 0

The number of user stack level to keep for variables during Theano compilation. If higher then 0, will make us keep Theano internal stack trace.

config.metaopt.verbose[source]

Int value, default: 0

The verbosity level of the meta-optimizer. 0 for silent. 1 to only warn if we cannot meta-optimize some op. 2 for full output of separate timings and selected implementation

config.metaopt.optimizer_excluding[source]

Default: ""

A list of optimizer tags that we don’t want included in the Meta-optimizer. If multiple tags, separate them by ‘:’.

config.metaopt.optimizer_including[source]

Default: ""

A list of optimizer tags that we want included in the Meta-optimizer. If multiple tags, separate them by ‘:’.