tensorflow::ops::UnicodeTranscode::Attrs

#include <string_ops.h>

Optional attribute setters for UnicodeTranscode.

Summary

Public attributes
errors_ = "replace"
StringPiece
replace_control_characters_ = false
bool
replacement_char_ = 65533
int64
Public functions
Errors(StringPiece x)
TF_MUST_USE_RESULT Attrs
Error handling policy when there is invalid formatting found in the input.
ReplaceControlCharacters(bool x)
TF_MUST_USE_RESULT Attrs
Whether to replace the C0 control characters (00-1F) with the replacement_char.
ReplacementChar(int64 x)
TF_MUST_USE_RESULT Attrs
The replacement character codepoint to be used in place of any invalid formatting in the input when errors='replace'.

Public attributes

errors_

StringPiece tensorflow::ops::UnicodeTranscode::Attrs::errors_ = "replace"

replace_control_characters_

bool tensorflow::ops::UnicodeTranscode::Attrs::replace_control_characters_ = false

replacement_char_

int64 tensorflow::ops::UnicodeTranscode::Attrs::replacement_char_ = 65533

Public functions

Errors

TF_MUST_USE_RESULT Attrs tensorflow::ops::UnicodeTranscode::Attrs::Errors(
  StringPiece x
)

Error handling policy when there is invalid formatting found in the input.

The value of 'strict' will cause the operation to produce a InvalidArgument error on any invalid input formatting. A value of 'replace' (the default) will cause the operation to replace any invalid formatting in the input with the replacement_char codepoint. A value of 'ignore' will cause the operation to skip any invalid formatting in the input and produce no corresponding output character.

Defaults to "replace"

ReplaceControlCharacters

TF_MUST_USE_RESULT Attrs tensorflow::ops::UnicodeTranscode::Attrs::ReplaceControlCharacters(
  bool x
)

Whether to replace the C0 control characters (00-1F) with the replacement_char.

Default is false.

Defaults to false

ReplacementChar

TF_MUST_USE_RESULT Attrs tensorflow::ops::UnicodeTranscode::Attrs::ReplacementChar(
  int64 x
)

The replacement character codepoint to be used in place of any invalid formatting in the input when errors='replace'.

Any valid unicode codepoint may be used. The default value is the default unicode replacement character is 0xFFFD or U+65533.)

Note that for UTF-8, passing a replacement character expressible in 1 byte, such as ' ', will preserve string alignment to the source since invalid bytes will be replaced with a 1-byte replacement. For UTF-16-BE and UTF-16-LE, any 1 or 2 byte replacement character will preserve byte alignment to the source.

Defaults to 65533

© 2020 The TensorFlow Authors. All rights reserved.
Licensed under the Creative Commons Attribution License 4.0.
Code samples licensed under the Apache 2.0 License.
https://www.tensorflow.org/versions/r2.4/api_docs/cc/struct/tensorflow/ops/unicode-transcode/attrs