Skip to content

relu6实现有误 #166

@MARD1NO

Description

@MARD1NO

使用 flow.clip(x, 0, 6) 数值表现是跟 Relu6一致的
但是在求梯度的时候行为不一致

clip在边界值,如上例的0, 6 时候,梯度为1

而 Relu6在边界值的表现,梯度为0

现在正在开发 Relu6算子

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions