'compiler' Submodule
Introduction¶
from streamtensor import compiler
StreamTensor compiler module.
This module provides a high-level interface to the StreamTensor compiler.
It exposes a single function hls_pipeline that takes a serialized MLIR
module and a set of options, and returns a serialized MLIR module that has
been optimized for high-level synthesis (HLS) targeting FPGA devices.
CompileConfig(default_tile_size=16, overall_unroll_size=16, max_fusion_cost=8000, max_widen_bitwidth=512, num_uram=960, num_bram=4032, size_lutram_in_bit=36700000, resource_threshold=0.9, num_hbm_port=32, timeout_in_ms=1000, clock_freqhz=150000000, stream_sizing=True, pipeline_rewinding=True, constant_folding=True, create_kernel_wrapper=True, task_chain_merging=False, op_ii_map={'math.erf': 2}, stream_size_map=None, stream_full_size=False, fake_quantize=False, quantize_bitwidth=8, constant_quantize_bitwidth=8)
¶
Configuration for the StreamTensor compiler.
Attributes:
| Name | Type | Description |
|---|---|---|
default_tile_size |
int
|
The default tile size for linalg tiling. |
overall_unroll_size |
int
|
The overall unroll size for linalg tiling. |
max_fusion_cost |
int
|
The maximum fusion cost for greedy kernel fusion. |
max_widen_bitwidth |
int
|
The maximum bitwidth for dataflow optimization. |
num_uram |
int
|
The number of URAMs available on the target FPGA. |
num_bram |
int
|
The number of BRAMs available on the target FPGA. |
size_lutram_in_bit |
int
|
The size of LUTRAM in bits available on the target FPGA. |
resource_threshold |
float
|
The resource threshold for uram, bram, and lutram. |
num_hbm_port |
int
|
The number of HBM ports available on the target FPGA. |
timeout_in_ms |
int
|
The timeout in milliseconds when running the kernel. |
clock_freqhz |
int
|
The clock frequency in Hz of the target FPGA. |
stream_sizing |
bool
|
Whether to perform stream sizing. |
pipeline_rewinding |
bool
|
Whether to enable pipeline rewinding. |
constant_folding |
bool
|
Whether to perform constant folding. |
create_kernel_wrapper |
bool
|
Whether to create kernel wrapper function. |
task_chain_merging |
bool
|
Whether to merge task chains. |
op_ii_map |
Optional[Dict[str, int]]
|
The map from op name to its initiation interval on hardware. |
stream_size_map |
Optional[Dict[Tuple[str, str], int]]
|
The overriding map from edge to stream size. |
stream_full_size |
bool
|
Set all stream sizes to the maximum (token number). |
fake_quantize |
bool
|
Whether to apply fake quantization. |
quantize_bitwidth |
int
|
The bitwidth for fake quantization. |
constant_quantize_bitwidth |
int
|
The bitwidth of constants for fake quantization. |
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
default_tile_size
|
int
|
The default tile size for linalg tiling. |
16
|
overall_unroll_size
|
int
|
The overall unroll size for linalg tiling. |
16
|
max_fusion_cost
|
int
|
The maximum fusion cost for greedy kernel fusion. |
8000
|
max_widen_bitwidth
|
int
|
The maximum bitwidth for dataflow optimization. |
512
|
num_uram
|
int
|
The number of URAMs available on the target FPGA. |
960
|
num_bram
|
int
|
The number of BRAMs available on the target FPGA. |
4032
|
size_lutram_in_bit
|
int
|
The size of LUTRAM in bits available on the target FPGA. |
36700000
|
resource_threshold
|
float
|
The resource threshold for uram, bram, and lutram. |
0.9
|
num_hbm_port
|
int
|
The number of HBM ports available on the target FPGA. |
32
|
timeout_in_ms
|
int
|
The timeout in milliseconds when running the kernel. |
1000
|
clock_freqhz
|
int
|
The clock frequency in Hz of the target FPGA. |
150000000
|
stream_sizing
|
bool
|
Whether to perform stream sizing. |
True
|
pipeline_rewinding
|
bool
|
Whether to enable pipeline rewinding. |
True
|
constant_folding
|
bool
|
Whether to perform constant folding. |
True
|
create_kernel_wrapper
|
bool
|
Whether to create kernel wrapper function. |
True
|
task_chain_merging
|
bool
|
Whether to merge task chains. |
False
|
op_ii_map
|
Optional[Dict[str, int]]
|
The map from op name to its initiation interval on hardware. |
{'math.erf': 2}
|
stream_size_map
|
Optional[Dict[Tuple[str, str], int]]
|
The overriding map from edge to stream size. |
None
|
stream_full_size
|
bool
|
Set all stream sizes to the maximum (token number). |
False
|
fake_quantize
|
bool
|
Whether to apply fake quantization. |
False
|
quantize_bitwidth
|
int
|
The bitwidth for fake quantization. |
8
|
constant_quantize_bitwidth
|
int
|
The bitwidth of constants for fake quantization. |
8
|
Compiler(work_path='.', config=CompileConfig())
¶
StreamTensor compiler.
Attributes:
| Name | Type | Description |
|---|---|---|
work_path |
Path
|
The working directory for the compiler. |
config |
CompileConfig
|
The configuration for the compiler. |
hls_pipeline(module_bytes, module_name, print_dot=True, from_stage=HLSPipelineStage.START, to_stage=HLSPipelineStage.END, synthesis_config=SynthesisConfig())
¶
Compiles a serialized MLIR module for high-level synthesis (HLS).
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
module_bytes
|
bytes
|
The serialized MLIR module to compile. |
required |
module_name
|
str
|
The name of the module. |
required |
print_dot
|
bool
|
Whether to print the dataflow graph as a DOT file. |
True
|
from_stage
|
HLSPipelineStage
|
The stage to start the compilation from. |
START
|
to_stage
|
HLSPipelineStage
|
The stage to stop the compilation at. |
END
|
synthesis_config
|
SynthesisConfig
|
The configuration for the synthesis. |
SynthesisConfig()
|
Returns:
| Type | Description |
|---|---|
Module
|
The compiled serialized MLIR module. |
HLSPipelineStage
¶
Bases: Enum
The stages in the HLS pipeline.
compile_hls_pipeline(module_bytes, module_name, print_dot=True, from_stage=HLSPipelineStage.START, to_stage=HLSPipelineStage.END, work_path='.', compile_config=CompileConfig(), synthesis_config=SynthesisConfig())
¶
Compiles a serialized MLIR module for high-level synthesis (HLS).
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
module_bytes
|
bytes
|
The serialized MLIR module to compile. |
required |
module_name
|
str
|
The name of the module. |
required |
print_dot
|
bool
|
Whether to print the dataflow graph as a DOT file. |
True
|
from_stage
|
HLSPipelineStage
|
The stage to start the compilation from. |
START
|
to_stage
|
HLSPipelineStage
|
The stage to stop the compilation at. |
END
|
work_path
|
str
|
The working directory for the compiler. |
'.'
|
compile_config
|
CompileConfig
|
The configuration for the compiler. |
CompileConfig()
|
synthesis_config
|
SynthesisConfig
|
The configuration for the synthesis. |
SynthesisConfig()
|
Returns:
| Type | Description |
|---|---|
Module
|
The compiled serialized MLIR module. |