tvm.target

Target management API of TVM.

TVM’s target string is in fomat <target_name> [-option=value]....

Note

The list of options include:

  • -device=<device name>

    The device name.

  • -mtriple=<target triple> or -target

    Specify the target triple, which is useful for cross compilation.

  • -mcpu=<cpuname>

    Specify a specific chip in the current architecture to generate code for. By default this is infered from the target triple and autodetected to the current architecture.

  • -mattr=a1,+a2,-a3,…

    Override or control specific attributes of the target, such as whether SIMD operations are enabled or not. The default set of attributes is set by the current CPU.

  • -system-lib

    Build TVM system library module. System lib is a global module that contains self registered functions in program startup. User can get the module using tvm.module.system_lib. It is useful in environments where dynamic loading api like dlopen is banned. The system lib will be available as long as the result code is linked by the program.

We can use tvm.target.create to create a tvm.target.Target from the target string. We can also use other specific function in this module to create specific targets.

tvm.target.generic_func(fdefault)

Wrap a target generic function.

Generic function allows registeration of further functions that can be dispatched on current target context. If no registered dispatch is matched, the fdefault will be called.

Parameters:fdefault (function) – The default function.
Returns:fgeneric – A wrapped generic function.
Return type:function

Example

import tvm
# wrap function as target generic
@tvm.target.generic_func
def my_func(a):
    return a + 1
# register specialization of my_func under target cuda
@my_func.register("cuda")
def my_func_cuda(a):
    return a + 2
# displays 3, because my_func is called
print(my_func(2))
# displays 4, because my_func_cuda is called
with tvm.target.cuda():
    print(my_func(2))
class tvm.target.Target(target_name, options=None)

Target device information, use through TVM API.

Parameters:
  • target_name ({"llvm", "cuda", "opencl", "metal", "rocm", "stackvm", "opengl", "ext_dev"}) – The major target name.
  • options (list of str, optional) – Additional arguments appended to the target.

Note

Do not use class constructor, you can create target using the following functions

tvm.target.cuda(options=None)

Returns a cuda target.

Parameters:options (list of str) – Additional options
tvm.target.rocm(options=None)

Returns a ROCM target.

Parameters:options (list of str) – Additional options
tvm.target.rasp(options=None)

Returns a rasp target.

Parameters:options (list of str) – Additional options
tvm.target.create(target_str)

Get a target given target string.

Parameters:target_str (str) – The target string.
Returns:target – The target object
Return type:Target

Note

See the note on tvm.target on target string format.