arXiv · cs.AI · Anna Zykova-Myzina, Timofei Gritsaev, Daniil Tiapkin, Nikita Morozov · 8 小时前模型评分31
研究者首次将近端策略优化用于 GFlowNet 训练
Proximal Policy Optimization for Amortized Discrete Sampling
导读
研究者在生成流网络(GFlowNet,Generative Flow Network)框架下推导出标准策略梯度算法的对应形式,并首次将近端策略优化(PPO,Proximal Policy Optimization)成功应用于 GFlowNet 训练。在合成能量到分子图生成的基准上,该方法的收敛速度和数据效率均优于标准 GFlowNet 训练目标。
分类置信度
中 · 待人工复核
- 只有单一媒体来源,需要人工复核。
来源级别:媒体与个人
事件类型:研究发布
证据摘录
- “Most importantly, our work is the first to derive and successfully apply proximal policy optimization to GFlowNets, showing its improved convergence speed and data efficiency compared to standard GFlowNet training objectives on benchmarks ranging from synthetic energies to molecular graph generation.”
来源:arXiv · cs.AI · arxiv.org