Files
nvidia-nemo--speech/scripts/tokenizers/conf/tabular_data_tokenizer.yaml
T
wehub-resource-sync ba4be087d5
Create PR to main with cherry-pick from release / cherry-pick (push) Failing after 0s
CICD NeMo / pre-flight (push) Failing after 0s
CICD NeMo / configure (push) Has been skipped
Build, validate, and release Neural Modules / pre-flight (push) Failing after 1s
CICD NeMo / code-linting (push) Has been skipped
Build, validate, and release Neural Modules / release (push) Has been skipped
Build, validate, and release Neural Modules / release-summary (push) Has been cancelled
CICD NeMo / cicd-test-container-build (push) Has been cancelled
CICD NeMo / cicd-import-tests (push) Has been cancelled
CICD NeMo / L0_Setup_Test_Data_And_Models (push) Has been cancelled
CICD NeMo / cicd-main-unit-tests (push) Has been cancelled
CICD NeMo / cicd-main-speech (push) Has been cancelled
CICD NeMo / Nemo_CICD_Test (push) Has been cancelled
CICD NeMo / Coverage (e2e) (push) Has been cancelled
CICD NeMo / Coverage (unit-test) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
CICD NeMo / cicd-wait-in-queue (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 13:28:58 +08:00

34 lines
1007 B
YAML

table_structure:
- name: col_a
code_type: float
args:
code_len: 4 # number of tokens used to code the column
base: 16 # the positional base number. ie. it uses 16 tokens for one digit
fillall: False # whether to use full base number for each token or derive it from the data.
hasnan: False # can it handles nan or not
transform: yeo-johnson # can be ['yeo-johnson', 'quantile', 'robust'], check https://scikit-learn.org/stable/modules/classes.html#module-sklearn.preprocessing
- name: col_b
code_type: float
args:
code_len: 4
base: 32
fillall: True
hasnan: True
transform: quantile
- name: col_c
code_type: int
args:
code_len: 3
base: 12
fillall: True
hasnan: True
- name: col_d
code_type: category
args:
code_len: 3
base: 12
fillall: True
hasnan: True
tokenizer_file: ??? # tabular tokneizer output file path
table_csv_file: ??? # input table csv file