使用 Nevergrad 运行 Tune 实验

在本教程中，我们将介绍 Nevergrad，同时运行一个简单的 Ray Tune 实验。Tune 的搜索算法与 Nevergrad 集成，因此你可以无缝地扩展 Nevergrad 优化过程，而不会牺牲性能。

Nevergrad 提供无梯度/无导数优化，能够处理目标函数景观上的噪声，包括进化算法、bandit 算法和贝叶斯优化算法。Nevergrad 内部支持连续、离散或混合的搜索空间。它还提供了一个函数库，用于测试优化算法并与其他基准进行比较。

在本例中，我们最小化一个简单目标，简要演示通过 NevergradSearch 在 Ray Tune 中使用 Nevergrad。需要注意的是，尽管侧重于机器学习实验，Ray Tune 可以优化任何隐式或显式目标。这里我们假设已安装 nevergrad==0.4.3.post7 库。欲了解更多信息，请参考 Nevergrad 网站。

所需条件

• pip install ray[tune] nevergrad==0.4.3.post7

点击下方查看本示例所需的所有导入。

显示代码单元格源 隐藏代码单元格源

import time

import ray
import nevergrad as ng
from ray import tune
from ray.tune.search import ConcurrencyLimiter
from ray.tune.search.nevergrad import NevergradSearch

/Users/kai/.pyenv/versions/3.7.7/lib/python3.7/site-packages/nevergrad/optimization/differentialevolution.py:107: InefficientSettingsWarning: DE algorithms are inefficient with budget < 60
  "DE algorithms are inefficient with budget < 60", base.errors.InefficientSettingsWarning

让我们首先定义一个简单的评估函数。我们人为地休眠一小段时间（0.1 秒）来模拟一个长时间运行的 ML 实验。这个设置假设我们正在运行实验的多个 step，并尝试调优两个超参数，即 width 和 height，以及 activation。

def evaluate(step, width, height, activation):
    time.sleep(0.1)
    activation_boost = 10 if activation=="relu" else 1
    return (0.1 + width * step / 100) ** (-1) + height * 0.1 + activation_boost

接下来，我们的 objective 函数接受一个 Tune config，在训练循环中评估实验的 score，并使用 tune.report 将 score 报告回 Tune。

def objective(config):
    for step in range(config["steps"]):
        score = evaluate(step, config["width"], config["height"], config["activation"])
        tune.report({"iterations": step, "mean_loss": score})

现在我们使用 ConfigSpace 构建超参数搜索空间

接下来，我们定义基于 NevergradSearch 构建的搜索算法，使用 ConcurrencyLimiter 将并发试验数限制在最大 4 个。这里我们使用 ng.optimizers.OnePlusOne，这是一个简单的进化算法。

algo = NevergradSearch(
    optimizer=ng.optimizers.OnePlusOne,
)
algo = tune.search.ConcurrencyLimiter(algo, max_concurrent=4)

样本数是指将尝试的超参数组合数。此 Tune 运行设置为 1000 个样本。（如果你的机器上运行时间过长，可以减少此数量）。

num_samples = 1000

最后，剩下的就是定义搜索空间了。

search_config = {
    "steps": 100,
    "width": tune.uniform(0, 20),
    "height": tune.uniform(-100, 100),
    "activation": tune.choice(["relu, tanh"])
}

最后，我们运行实验，通过 algo 在 search_space 中搜索 num_samples 次，以 "min"imize（最小化）objective 的“mean_loss”。前一句话完整地描述了我们旨在解决的搜索问题。考虑到这一点，请注意执行 tuner.fit() 的效率有多高。

tuner = tune.Tuner(
    objective,
    tune_config=tune.TuneConfig(
        metric="mean_loss",
        mode="min",
        search_alg=algo,
        num_samples=num_samples,
    ),
    param_space=search_config,
)
results = tuner.fit()

WARNING:ray.tune.trainable.function_trainable:

== 状态 ==
当前时间：2022-07-22 15:24:44 (已运行 00:00:43.69)
此节点内存使用：10.4/16.0 GiB
使用 FIFO 调度算法。
请求资源：0/16 CPU, 0/0 GPU, 0.0/4.61 GiB 堆内存, 0.0/2.0 GiB 对象
当前最佳试验：004f499a，mean_loss=-7.595329711238255，参数为 {'steps': 100, 'width': 2.1174116156230918, 'height': -90.50653873694615, 'activation': 'relu, tanh'}
结果日志目录：/Users/kai/ray_results/objective_2022-07-22_15-23-59
试验数量：10/10 (10 已终止)

试验名称	状态	loc	激活函数	height	width	损失	迭代次数	总时间 (秒)	迭代次数	负平均损失
objective_ee2ca136	已终止	127.0.0.1:46434	relu, tanh	0	10	1.1	100	10.942	99	-1.1
objective_efe1626e	已终止	127.0.0.1:46441	relu, tanh	-31.0013	9.28761	-1.99254	100	11.5354	99	1.99254
objective_efe34e4e	已终止	127.0.0.1:46442	relu, tanh	5.21403	9.48974	1.62672	100	11.6606	99	-1.62672
objective_efe55c2a	已终止	127.0.0.1:46443	relu, tanh	-20.8721	11.3958	-0.99935	100	11.6083	99	0.99935
objective_f6688086	已终止	127.0.0.1:46467	relu, tanh	57.2829	17.7296	6.78493	100	10.716	99	-6.78493
objective_f85ed926	已终止	127.0.0.1:46478	relu, tanh	40.5543	19.0813	5.10809	100	10.7158	99	-5.10809
objective_f86ee276	已终止	127.0.0.1:46481	relu, tanh	93.8686	1.60757	10.9781	100	10.7415	99	-10.9781
objective_f880a02e	已终止	127.0.0.1:46484	relu, tanh	-80.5769	5.84852	-6.88791	100	10.7335	99	6.88791
objective_fe4e7a44	已终止	127.0.0.1:46499	relu, tanh	9.62911	0.622909	3.35823	100	13.1428	99	-3.35823
objective_004f499a	已终止	127.0.0.1:46504	relu, tanh	-90.5065	2.11741	-7.59533	100	10.7688	99	7.59533

INFO:ray._private.runtime_env.plugin_schema_manager:Loading the default runtime env schemas: ['/Users/kai/coding/ray/python/ray/_private/runtime_env/../../runtime_env/schemas/working_dir_schema.json', '/Users/kai/coding/ray/python/ray/_private/runtime_env/../../runtime_env/schemas/pip_schema.json'].

Result for objective_ee2ca136:
  date: 2022-07-22_15-24-03
  done: false
  experiment_id: c0ad5ddb78cc4cc88e8195f5bde34e20
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 11.0
  neg_mean_loss: -11.0
  node_ip: 127.0.0.1
  pid: 46434
  time_since_restore: 0.10390329360961914
  time_this_iter_s: 0.10390329360961914
  time_total_s: 0.10390329360961914
  timestamp: 1658499843
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: ee2ca136
  warmup_time: 0.003058910369873047
  
Result for objective_efe1626e:
  date: 2022-07-22_15-24-06
  done: false
  experiment_id: c6d33a9a30c040c0929b657f1d3e1557
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 7.899868000941147
  neg_mean_loss: -7.899868000941147
  node_ip: 127.0.0.1
  pid: 46441
  time_since_restore: 0.10202908515930176
  time_this_iter_s: 0.10202908515930176
  time_total_s: 0.10202908515930176
  timestamp: 1658499846
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: efe1626e
  warmup_time: 0.003210783004760742
  
Result for objective_efe55c2a:
  date: 2022-07-22_15-24-06
  done: false
  experiment_id: 903e9605ba894aa0bc55297229b8a77b
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 8.91279068144465
  neg_mean_loss: -8.91279068144465
  node_ip: 127.0.0.1
  pid: 46443
  time_since_restore: 0.1029670238494873
  time_this_iter_s: 0.1029670238494873
  time_total_s: 0.1029670238494873
  timestamp: 1658499846
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: efe55c2a
  warmup_time: 0.0031630992889404297
  
Result for objective_efe34e4e:
  date: 2022-07-22_15-24-06
  done: false
  experiment_id: 1efbb9c1becb436e8f304b61e9edd61b
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 11.521403250268252
  neg_mean_loss: -11.521403250268252
  node_ip: 127.0.0.1
  pid: 46442
  time_since_restore: 0.10443997383117676
  time_this_iter_s: 0.10443997383117676
  time_total_s: 0.10443997383117676
  timestamp: 1658499846
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: efe34e4e
  warmup_time: 0.002650022506713867
  
Result for objective_ee2ca136:
  date: 2022-07-22_15-24-08
  done: false
  experiment_id: c0ad5ddb78cc4cc88e8195f5bde34e20
  hostname: Kais-MacBook-Pro.local
  iterations: 45
  iterations_since_restore: 46
  mean_loss: 1.2173913043478262
  neg_mean_loss: -1.2173913043478262
  node_ip: 127.0.0.1
  pid: 46434
  time_since_restore: 5.145823955535889
  time_this_iter_s: 0.10791492462158203
  time_total_s: 5.145823955535889
  timestamp: 1658499848
  timesteps_since_restore: 0
  training_iteration: 46
  trial_id: ee2ca136
  warmup_time: 0.003058910369873047
  
Result for objective_efe1626e:
  date: 2022-07-22_15-24-11
  done: false
  experiment_id: c6d33a9a30c040c0929b657f1d3e1557
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -1.8761766831351419
  neg_mean_loss: 1.8761766831351419
  node_ip: 127.0.0.1
  pid: 46441
  time_since_restore: 5.138395071029663
  time_this_iter_s: 0.10561490058898926
  time_total_s: 5.138395071029663
  timestamp: 1658499851
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: efe1626e
  warmup_time: 0.003210783004760742
  
Result for objective_efe55c2a:
  date: 2022-07-22_15-24-11
  done: false
  experiment_id: 903e9605ba894aa0bc55297229b8a77b
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -0.9039251143764186
  neg_mean_loss: 0.9039251143764186
  node_ip: 127.0.0.1
  pid: 46443
  time_since_restore: 5.145689249038696
  time_this_iter_s: 0.10677504539489746
  time_total_s: 5.145689249038696
  timestamp: 1658499851
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: efe55c2a
  warmup_time: 0.0031630992889404297
  
Result for objective_efe34e4e:
  date: 2022-07-22_15-24-11
  done: false
  experiment_id: 1efbb9c1becb436e8f304b61e9edd61b
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 1.7406930109818743
  neg_mean_loss: -1.7406930109818743
  node_ip: 127.0.0.1
  pid: 46442
  time_since_restore: 5.151263952255249
  time_this_iter_s: 0.10529589653015137
  time_total_s: 5.151263952255249
  timestamp: 1658499851
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: efe34e4e
  warmup_time: 0.002650022506713867
  
Result for objective_ee2ca136:
  date: 2022-07-22_15-24-13
  done: false
  experiment_id: c0ad5ddb78cc4cc88e8195f5bde34e20
  hostname: Kais-MacBook-Pro.local
  iterations: 92
  iterations_since_restore: 93
  mean_loss: 1.10752688172043
  neg_mean_loss: -1.10752688172043
  node_ip: 127.0.0.1
  pid: 46434
  time_since_restore: 10.185918092727661
  time_this_iter_s: 0.10853385925292969
  time_total_s: 10.185918092727661
  timestamp: 1658499853
  timesteps_since_restore: 0
  training_iteration: 93
  trial_id: ee2ca136
  warmup_time: 0.003058910369873047
  
Result for objective_ee2ca136:
  date: 2022-07-22_15-24-14
  done: true
  experiment_id: c0ad5ddb78cc4cc88e8195f5bde34e20
  experiment_tag: 1_activation=relu_tanh,height=0.0000,steps=100,width=10.0000
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 1.1
  neg_mean_loss: -1.1
  node_ip: 127.0.0.1
  pid: 46434
  time_since_restore: 10.941971063613892
  time_this_iter_s: 0.10557413101196289
  time_total_s: 10.941971063613892
  timestamp: 1658499854
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: ee2ca136
  warmup_time: 0.003058910369873047
  
Result for objective_efe34e4e:
  date: 2022-07-22_15-24-16
  done: false
  experiment_id: 1efbb9c1becb436e8f304b61e9edd61b
  hostname: Kais-MacBook-Pro.local
  iterations: 90
  iterations_since_restore: 91
  mean_loss: 1.63713376556457
  neg_mean_loss: -1.63713376556457
  node_ip: 127.0.0.1
  pid: 46442
  time_since_restore: 9.770322799682617
  time_this_iter_s: 0.1040806770324707
  time_total_s: 9.770322799682617
  timestamp: 1658499856
  timesteps_since_restore: 0
  training_iteration: 91
  trial_id: efe34e4e
  warmup_time: 0.002650022506713867
  
Result for objective_efe1626e:
  date: 2022-07-22_15-24-16
  done: false
  experiment_id: c6d33a9a30c040c0929b657f1d3e1557
  hostname: Kais-MacBook-Pro.local
  iterations: 92
  iterations_since_restore: 93
  mean_loss: -1.9844528559710652
  neg_mean_loss: 1.9844528559710652
  node_ip: 127.0.0.1
  pid: 46441
  time_since_restore: 9.955276012420654
  time_this_iter_s: 0.10721087455749512
  time_total_s: 9.955276012420654
  timestamp: 1658499856
  timesteps_since_restore: 0
  training_iteration: 93
  trial_id: efe1626e
  warmup_time: 0.003210783004760742
  
Result for objective_efe55c2a:
  date: 2022-07-22_15-24-16
  done: false
  experiment_id: 903e9605ba894aa0bc55297229b8a77b
  hostname: Kais-MacBook-Pro.local
  iterations: 91
  iterations_since_restore: 92
  mean_loss: -0.991699632507838
  neg_mean_loss: 0.991699632507838
  node_ip: 127.0.0.1
  pid: 46443
  time_since_restore: 9.83866286277771
  time_this_iter_s: 0.10593676567077637
  time_total_s: 9.83866286277771
  timestamp: 1658499856
  timesteps_since_restore: 0
  training_iteration: 92
  trial_id: efe55c2a
  warmup_time: 0.0031630992889404297
  
Result for objective_f6688086:
  date: 2022-07-22_15-24-17
  done: false
  experiment_id: aa090556819b41c5b1e93d761dc9311a
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 16.728285222315503
  neg_mean_loss: -16.728285222315503
  node_ip: 127.0.0.1
  pid: 46467
  time_since_restore: 0.10288572311401367
  time_this_iter_s: 0.10288572311401367
  time_total_s: 0.10288572311401367
  timestamp: 1658499857
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: f6688086
  warmup_time: 0.002875089645385742
  
Result for objective_efe1626e:
  date: 2022-07-22_15-24-17
  done: true
  experiment_id: c6d33a9a30c040c0929b657f1d3e1557
  experiment_tag: 2_activation=relu_tanh,height=-31.0013,steps=100,width=9.2876
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -1.9925441896649678
  neg_mean_loss: 1.9925441896649678
  node_ip: 127.0.0.1
  pid: 46441
  time_since_restore: 11.535439252853394
  time_this_iter_s: 0.10611414909362793
  time_total_s: 11.535439252853394
  timestamp: 1658499857
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: efe1626e
  warmup_time: 0.003210783004760742
  
Result for objective_efe55c2a:
  date: 2022-07-22_15-24-17
  done: true
  experiment_id: 903e9605ba894aa0bc55297229b8a77b
  experiment_tag: 4_activation=relu_tanh,height=-20.8721,steps=100,width=11.3958
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -0.9993497773424045
  neg_mean_loss: 0.9993497773424045
  node_ip: 127.0.0.1
  pid: 46443
  time_since_restore: 11.608299970626831
  time_this_iter_s: 0.10889291763305664
  time_total_s: 11.608299970626831
  timestamp: 1658499857
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: efe55c2a
  warmup_time: 0.0031630992889404297
  

Result for objective_efe34e4e:
  date: 2022-07-22_15-24-18
  done: true
  experiment_id: 1efbb9c1becb436e8f304b61e9edd61b
  experiment_tag: 3_activation=relu_tanh,height=5.2140,steps=100,width=9.4897
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 1.6267236167220034
  neg_mean_loss: -1.6267236167220034
  node_ip: 127.0.0.1
  pid: 46442
  time_since_restore: 11.660571098327637
  time_this_iter_s: 0.1082301139831543
  time_total_s: 11.660571098327637
  timestamp: 1658499858
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: efe34e4e
  warmup_time: 0.002650022506713867
  
Result for objective_f85ed926:
  date: 2022-07-22_15-24-20
  done: false
  experiment_id: 402684968ef24377ae7787c9af50d3ae
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 15.055429995999226
  neg_mean_loss: -15.055429995999226
  node_ip: 127.0.0.1
  pid: 46478
  time_since_restore: 0.10394287109375
  time_this_iter_s: 0.10394287109375
  time_total_s: 0.10394287109375
  timestamp: 1658499860
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: f85ed926
  warmup_time: 0.0031621456146240234
  
Result for objective_f86ee276:
  date: 2022-07-22_15-24-20
  done: false
  experiment_id: cbdc4d94c3d64e59aa53e4465349dbe1
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 20.386860838650087
  neg_mean_loss: -20.386860838650087
  node_ip: 127.0.0.1
  pid: 46481
  time_since_restore: 0.10312676429748535
  time_this_iter_s: 0.10312676429748535
  time_total_s: 0.10312676429748535
  timestamp: 1658499860
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: f86ee276
  warmup_time: 0.002810955047607422
  
Result for objective_f880a02e:
  date: 2022-07-22_15-24-20
  done: false
  experiment_id: fb5af0209b2b45eda67ab40960a48a99
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 2.94231225430282
  neg_mean_loss: -2.94231225430282
  node_ip: 127.0.0.1
  pid: 46484
  time_since_restore: 0.10325503349304199
  time_this_iter_s: 0.10325503349304199
  time_total_s: 0.10325503349304199
  timestamp: 1658499860
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: f880a02e
  warmup_time: 0.0027141571044921875
  
Result for objective_f6688086:
  date: 2022-07-22_15-24-22
  done: false
  experiment_id: aa090556819b41c5b1e93d761dc9311a
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 6.846867893893624
  neg_mean_loss: -6.846867893893624
  node_ip: 127.0.0.1
  pid: 46467
  time_since_restore: 5.122231721878052
  time_this_iter_s: 0.10641169548034668
  time_total_s: 5.122231721878052
  timestamp: 1658499862
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: f6688086
  warmup_time: 0.002875089645385742
  
Result for objective_f85ed926:
  date: 2022-07-22_15-24-25
  done: false
  experiment_id: 402684968ef24377ae7787c9af50d3ae
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 5.1657053480548045
  neg_mean_loss: -5.1657053480548045
  node_ip: 127.0.0.1
  pid: 46478
  time_since_restore: 5.151860952377319
  time_this_iter_s: 0.10704493522644043
  time_total_s: 5.151860952377319
  timestamp: 1658499865
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: f85ed926
  warmup_time: 0.0031621456146240234
  
Result for objective_f86ee276:
  date: 2022-07-22_15-24-25
  done: false
  experiment_id: cbdc4d94c3d64e59aa53e4465349dbe1
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 11.55568804118157
  neg_mean_loss: -11.55568804118157
  node_ip: 127.0.0.1
  pid: 46481
  time_since_restore: 5.140729665756226
  time_this_iter_s: 0.1076810359954834
  time_total_s: 5.140729665756226
  timestamp: 1658499865
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: f86ee276
  warmup_time: 0.002810955047607422
  
Result for objective_f880a02e:
  date: 2022-07-22_15-24-25
  done: false
  experiment_id: fb5af0209b2b45eda67ab40960a48a99
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -6.706663109525936
  neg_mean_loss: 6.706663109525936
  node_ip: 127.0.0.1
  pid: 46484
  time_since_restore: 5.157264947891235
  time_this_iter_s: 0.1107029914855957
  time_total_s: 5.157264947891235
  timestamp: 1658499865
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: f880a02e
  warmup_time: 0.0027141571044921875
  
Result for objective_f6688086:
  date: 2022-07-22_15-24-27
  done: false
  experiment_id: aa090556819b41c5b1e93d761dc9311a
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 6.787930201151392
  neg_mean_loss: -6.787930201151392
  node_ip: 127.0.0.1
  pid: 46467
  time_since_restore: 10.178911924362183
  time_this_iter_s: 0.10588788986206055
  time_total_s: 10.178911924362183
  timestamp: 1658499867
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: f6688086
  warmup_time: 0.002875089645385742
  
Result for objective_f6688086:
  date: 2022-07-22_15-24-27
  done: true
  experiment_id: aa090556819b41c5b1e93d761dc9311a
  experiment_tag: 5_activation=relu_tanh,height=57.2829,steps=100,width=17.7296
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 6.784934893475021
  neg_mean_loss: -6.784934893475021
  node_ip: 127.0.0.1
  pid: 46467
  time_since_restore: 10.71599006652832
  time_this_iter_s: 0.10760498046875
  time_total_s: 10.71599006652832
  timestamp: 1658499867
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: f6688086
  warmup_time: 0.002875089645385742
  
Result for objective_fe4e7a44:
  date: 2022-07-22_15-24-30
  done: false
  experiment_id: 95711fcb897a4f9fae3ebd811619fba9
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 11.962911259228687
  neg_mean_loss: -11.962911259228687
  node_ip: 127.0.0.1
  pid: 46499
  time_since_restore: 0.10338783264160156
  time_this_iter_s: 0.10338783264160156
  time_total_s: 0.10338783264160156
  timestamp: 1658499870
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: fe4e7a44
  warmup_time: 0.002811908721923828
  
Result for objective_f85ed926:
  date: 2022-07-22_15-24-30
  done: false
  experiment_id: 402684968ef24377ae7787c9af50d3ae
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 5.110873373928027
  neg_mean_loss: -5.110873373928027
  node_ip: 127.0.0.1
  pid: 46478
  time_since_restore: 10.178997039794922
  time_this_iter_s: 0.10618400573730469
  time_total_s: 10.178997039794922
  timestamp: 1658499870
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: f85ed926
  warmup_time: 0.0031621456146240234
  
Result for objective_f86ee276:
  date: 2022-07-22_15-24-30
  done: false
  experiment_id: cbdc4d94c3d64e59aa53e4465349dbe1
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 11.007548256848812
  neg_mean_loss: -11.007548256848812
  node_ip: 127.0.0.1
  pid: 46481
  time_since_restore: 10.165759801864624
  time_this_iter_s: 0.10771489143371582
  time_total_s: 10.165759801864624
  timestamp: 1658499870
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: f86ee276
  warmup_time: 0.002810955047607422
  
Result for objective_f880a02e:
  date: 2022-07-22_15-24-30
  done: false
  experiment_id: fb5af0209b2b45eda67ab40960a48a99
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: -6.87903993853598
  neg_mean_loss: 6.87903993853598
  node_ip: 127.0.0.1
  pid: 46484
  time_since_restore: 10.188904047012329
  time_this_iter_s: 0.10939908027648926
  time_total_s: 10.188904047012329
  timestamp: 1658499870
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: f880a02e
  warmup_time: 0.0027141571044921875
  
Result for objective_f85ed926:
  date: 2022-07-22_15-24-31
  done: true
  experiment_id: 402684968ef24377ae7787c9af50d3ae
  experiment_tag: 6_activation=relu_tanh,height=40.5543,steps=100,width=19.0813
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 5.108087948450606
  neg_mean_loss: -5.108087948450606
  node_ip: 127.0.0.1
  pid: 46478
  time_since_restore: 10.71581220626831
  time_this_iter_s: 0.10749602317810059
  time_total_s: 10.71581220626831
  timestamp: 1658499871
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: f85ed926
  warmup_time: 0.0031621456146240234
  

Result for objective_f86ee276:
  date: 2022-07-22_15-24-31
  done: true
  experiment_id: cbdc4d94c3d64e59aa53e4465349dbe1
  experiment_tag: 7_activation=relu_tanh,height=93.8686,steps=100,width=1.6076
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 10.978053669828887
  neg_mean_loss: -10.978053669828887
  node_ip: 127.0.0.1
  pid: 46481
  time_since_restore: 10.741472005844116
  time_this_iter_s: 0.1456291675567627
  time_total_s: 10.741472005844116
  timestamp: 1658499871
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: f86ee276
  warmup_time: 0.002810955047607422
  
Result for objective_f880a02e:
  date: 2022-07-22_15-24-31
  done: true
  experiment_id: fb5af0209b2b45eda67ab40960a48a99
  experiment_tag: 8_activation=relu_tanh,height=-80.5769,steps=100,width=5.8485
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -6.887909370541976
  neg_mean_loss: 6.887909370541976
  node_ip: 127.0.0.1
  pid: 46484
  time_since_restore: 10.733515977859497
  time_this_iter_s: 0.1060791015625
  time_total_s: 10.733515977859497
  timestamp: 1658499871
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: f880a02e
  warmup_time: 0.0027141571044921875
  
Result for objective_004f499a:
  date: 2022-07-22_15-24-33
  done: false
  experiment_id: c3015ffd206444cd9c2eb1152aae5dd0
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 1.9493461263053842
  neg_mean_loss: -1.9493461263053842
  node_ip: 127.0.0.1
  pid: 46504
  time_since_restore: 0.1044008731842041
  time_this_iter_s: 0.1044008731842041
  time_total_s: 0.1044008731842041
  timestamp: 1658499873
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 004f499a
  warmup_time: 0.0026237964630126953
  
Result for objective_fe4e7a44:
  date: 2022-07-22_15-24-35
  done: false
  experiment_id: 95711fcb897a4f9fae3ebd811619fba9
  hostname: Kais-MacBook-Pro.local
  iterations: 25
  iterations_since_restore: 26
  mean_loss: 5.873327389463485
  neg_mean_loss: -5.873327389463485
  node_ip: 127.0.0.1
  pid: 46499
  time_since_restore: 5.199802875518799
  time_this_iter_s: 0.1075749397277832
  time_total_s: 5.199802875518799
  timestamp: 1658499875
  timesteps_since_restore: 0
  training_iteration: 26
  trial_id: fe4e7a44
  warmup_time: 0.002811908721923828
  
Result for objective_004f499a:
  date: 2022-07-22_15-24-38
  done: false
  experiment_id: c3015ffd206444cd9c2eb1152aae5dd0
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -7.137564846035238
  neg_mean_loss: 7.137564846035238
  node_ip: 127.0.0.1
  pid: 46504
  time_since_restore: 5.15981912612915
  time_this_iter_s: 0.10737729072570801
  time_total_s: 5.15981912612915
  timestamp: 1658499878
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 004f499a
  warmup_time: 0.0026237964630126953
  
Result for objective_fe4e7a44:
  date: 2022-07-22_15-24-40
  done: false
  experiment_id: 95711fcb897a4f9fae3ebd811619fba9
  hostname: Kais-MacBook-Pro.local
  iterations: 72
  iterations_since_restore: 73
  mean_loss: 3.7860835740628094
  neg_mean_loss: -3.7860835740628094
  node_ip: 127.0.0.1
  pid: 46499
  time_since_restore: 10.234857082366943
  time_this_iter_s: 0.10819101333618164
  time_total_s: 10.234857082366943
  timestamp: 1658499880
  timesteps_since_restore: 0
  training_iteration: 73
  trial_id: fe4e7a44
  warmup_time: 0.002811908721923828
  
Result for objective_fe4e7a44:
  date: 2022-07-22_15-24-43
  done: true
  experiment_id: 95711fcb897a4f9fae3ebd811619fba9
  experiment_tag: 9_activation=relu_tanh,height=9.6291,steps=100,width=0.6229
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 3.3582342398877607
  neg_mean_loss: -3.3582342398877607
  node_ip: 127.0.0.1
  pid: 46499
  time_since_restore: 13.142819166183472
  time_this_iter_s: 0.10675215721130371
  time_total_s: 13.142819166183472
  timestamp: 1658499883
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: fe4e7a44
  warmup_time: 0.002811908721923828
  
Result for objective_004f499a:
  date: 2022-07-22_15-24-43
  done: false
  experiment_id: c3015ffd206444cd9c2eb1152aae5dd0
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: -7.572268959036313
  neg_mean_loss: 7.572268959036313
  node_ip: 127.0.0.1
  pid: 46504
  time_since_restore: 10.228418827056885
  time_this_iter_s: 0.10715484619140625
  time_total_s: 10.228418827056885
  timestamp: 1658499883
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: 004f499a
  warmup_time: 0.0026237964630126953
  
Result for objective_004f499a:
  date: 2022-07-22_15-24-44
  done: true
  experiment_id: c3015ffd206444cd9c2eb1152aae5dd0
  experiment_tag: 10_activation=relu_tanh,height=-90.5065,steps=100,width=2.1174
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -7.595329711238255
  neg_mean_loss: 7.595329711238255
  node_ip: 127.0.0.1
  pid: 46504
  time_since_restore: 10.768790006637573
  time_this_iter_s: 0.10774111747741699
  time_total_s: 10.768790006637573
  timestamp: 1658499884
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 004f499a
  warmup_time: 0.0026237964630126953
  

INFO:ray.tune.tune:Total run time: 44.70 seconds (43.68 seconds for the tuning loop).

以下是找到的最小化定义目标平均损失的超参数。

print("Best hyperparameters found were: ", results.get_best_result().config)

Best hyperparameters found were:  {'steps': 100, 'width': 2.1174116156230918, 'height': -90.50653873694615, 'activation': 'relu, tanh'}

可选：将（超）参数空间传递给搜索算法

我们还可以使用 Nevergrad 设计的格式将搜索空间传递给 NevergradSearch。

space = ng.p.Dict(
    width=ng.p.Scalar(lower=0, upper=20),
    height=ng.p.Scalar(lower=-100, upper=100),
    activation=ng.p.Choice(choices=["relu", "tanh"])
)

algo = NevergradSearch(
    optimizer=ng.optimizers.OnePlusOne,
    space=space,
    metric="mean_loss",
    mode="min"
)
algo = tune.search.ConcurrencyLimiter(algo, max_concurrent=4)

我们再次运行实验，这次通过 config 传递的内容较少，而是通过 search_alg 传递。

tuner = tune.Tuner(
    objective,
    tune_config=tune.TuneConfig(
#         metric="mean_loss",
#         mode="min",
        search_alg=algo,
        num_samples=num_samples,
    ),
    param_space={"steps": 100},
)
results = tuner.fit()

== 状态 ==
当前时间：2022-07-22 15:25:27 (已运行 00:00:43.22)
此节点内存使用：10.8/16.0 GiB
使用 FIFO 调度算法。
请求资源：0/16 CPU, 0/0 GPU, 0.0/4.61 GiB 堆内存, 0.0/2.0 GiB 对象
结果日志目录：/Users/kai/ray_results/objective_2022-07-22_15-24-44
试验数量：10/10 (10 已终止)

试验名称	状态	loc	激活函数	height	width	损失	迭代次数	总时间 (秒)	迭代次数	负平均损失
objective_085274be	已终止	127.0.0.1:46516	tanh	0	10	1.1	100	10.7324	99	-1.1
objective_09dee4f2	已终止	127.0.0.1:46524	tanh	-44.4216	12.9653	-3.36485	100	11.3476	99	3.36485
objective_09e0846a	已终止	127.0.0.1:46525	relu	-38.0638	11.1574	6.28334	100	11.3103	99	-6.28334
objective_09e21122	已终止	127.0.0.1:46526	relu	41.2509	9.75585	14.2276	100	11.3512	99	-14.2276
objective_1045958e	已终止	127.0.0.1:46544	relu	-73.2818	5.78832	2.84334	100	10.7372	99	-2.84334
objective_12309db2	已终止	127.0.0.1:46549	relu	-94.9666	16.9764	0.562486	100	10.7329	99	-0.562486
objective_12342770	已终止	127.0.0.1:46550	tanh	-98.0775	17.2252	-8.74945	100	10.7455	99	8.74945
objective_12374d7e	已终止	127.0.0.1:46551	relu	-1.60759	18.0841	9.89479	100	10.7348	99	-9.89479
objective_18344524	已终止	127.0.0.1:46569	tanh	-41.1284	12.2952	-3.03135	100	12.622	99	3.03135
objective_1a1e29b8	已终止	127.0.0.1:46576	tanh	64.0289	10.0482	7.50242	100	10.8237	99	-7.50242

Result for objective_085274be:
  date: 2022-07-22_15-24-47
  done: false
  experiment_id: be25590fb790400ca28b548b8359a120
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 11.0
  neg_mean_loss: -11.0
  node_ip: 127.0.0.1
  pid: 46516
  time_since_restore: 0.10224103927612305
  time_this_iter_s: 0.10224103927612305
  time_total_s: 0.10224103927612305
  timestamp: 1658499887
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 085274be
  warmup_time: 0.0029327869415283203
  
Result for objective_09dee4f2:
  date: 2022-07-22_15-24-49
  done: false
  experiment_id: 9469ffc8df11476db00e329acd2ae8b6
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 6.557843114006006
  neg_mean_loss: -6.557843114006006
  node_ip: 127.0.0.1
  pid: 46524
  time_since_restore: 0.10509586334228516
  time_this_iter_s: 0.10509586334228516
  time_total_s: 0.10509586334228516
  timestamp: 1658499889
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 09dee4f2
  warmup_time: 0.002938985824584961
  
Result for objective_09e21122:
  date: 2022-07-22_15-24-49
  done: false
  experiment_id: 0a825198482b4bd4aded6c318dff0dcf
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 24.125094234750687
  neg_mean_loss: -24.125094234750687
  node_ip: 127.0.0.1
  pid: 46526
  time_since_restore: 0.10476112365722656
  time_this_iter_s: 0.10476112365722656
  time_total_s: 0.10476112365722656
  timestamp: 1658499889
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 09e21122
  warmup_time: 0.003228902816772461
  
Result for objective_09e0846a:
  date: 2022-07-22_15-24-49
  done: false
  experiment_id: 260410fc1fb24f78af507cd38a8361a9
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 16.193619847512025
  neg_mean_loss: -16.193619847512025
  node_ip: 127.0.0.1
  pid: 46525
  time_since_restore: 0.10422873497009277
  time_this_iter_s: 0.10422873497009277
  time_total_s: 0.10422873497009277
  timestamp: 1658499889
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 09e0846a
  warmup_time: 0.002719879150390625
  
Result for objective_085274be:
  date: 2022-07-22_15-24-52
  done: false
  experiment_id: be25590fb790400ca28b548b8359a120
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 1.2083333333333333
  neg_mean_loss: -1.2083333333333333
  node_ip: 127.0.0.1
  pid: 46516
  time_since_restore: 5.132040977478027
  time_this_iter_s: 0.1084139347076416
  time_total_s: 5.132040977478027
  timestamp: 1658499892
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 085274be
  warmup_time: 0.0029327869415283203
  
Result for objective_09dee4f2:
  date: 2022-07-22_15-24-54
  done: false
  experiment_id: 9469ffc8df11476db00e329acd2ae8b6
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -3.280701838145472
  neg_mean_loss: 3.280701838145472
  node_ip: 127.0.0.1
  pid: 46524
  time_since_restore: 5.134023189544678
  time_this_iter_s: 0.10428118705749512
  time_total_s: 5.134023189544678
  timestamp: 1658499894
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 09dee4f2
  warmup_time: 0.002938985824584961
  
Result for objective_09e21122:
  date: 2022-07-22_15-24-54
  done: false
  experiment_id: 0a825198482b4bd4aded6c318dff0dcf
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 14.33852997141215
  neg_mean_loss: -14.33852997141215
  node_ip: 127.0.0.1
  pid: 46526
  time_since_restore: 5.139041185379028
  time_this_iter_s: 0.10721492767333984
  time_total_s: 5.139041185379028
  timestamp: 1658499894
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 09e21122
  warmup_time: 0.003228902816772461
  
Result for objective_09e0846a:
  date: 2022-07-22_15-24-54
  done: false
  experiment_id: 260410fc1fb24f78af507cd38a8361a9
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 6.3807469650477024
  neg_mean_loss: -6.3807469650477024
  node_ip: 127.0.0.1
  pid: 46525
  time_since_restore: 5.149268865585327
  time_this_iter_s: 0.10705304145812988
  time_total_s: 5.149268865585327
  timestamp: 1658499894
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 09e0846a
  warmup_time: 0.002719879150390625
  
Result for objective_085274be:
  date: 2022-07-22_15-24-57
  done: false
  experiment_id: be25590fb790400ca28b548b8359a120
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 1.1052631578947367
  neg_mean_loss: -1.1052631578947367
  node_ip: 127.0.0.1
  pid: 46516
  time_since_restore: 10.194181203842163
  time_this_iter_s: 0.10754203796386719
  time_total_s: 10.194181203842163
  timestamp: 1658499897
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: 085274be
  warmup_time: 0.0029327869415283203
  
Result for objective_085274be:
  date: 2022-07-22_15-24-57
  done: true
  experiment_id: be25590fb790400ca28b548b8359a120
  experiment_tag: 1_activation=tanh,height=0.0000,steps=100,width=10.0000
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 1.1
  neg_mean_loss: -1.1
  node_ip: 127.0.0.1
  pid: 46516
  time_since_restore: 10.732417106628418
  time_this_iter_s: 0.10759997367858887
  time_total_s: 10.732417106628418
  timestamp: 1658499897
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 085274be
  warmup_time: 0.0029327869415283203
  
Result for objective_09dee4f2:
  date: 2022-07-22_15-24-59
  done: false
  experiment_id: 9469ffc8df11476db00e329acd2ae8b6
  hostname: Kais-MacBook-Pro.local
  iterations: 93
  iterations_since_restore: 94
  mean_loss: -3.3599044605358728
  neg_mean_loss: 3.3599044605358728
  node_ip: 127.0.0.1
  pid: 46524
  time_since_restore: 10.055138111114502
  time_this_iter_s: 0.10467100143432617
  time_total_s: 10.055138111114502
  timestamp: 1658499899
  timesteps_since_restore: 0
  training_iteration: 94
  trial_id: 09dee4f2
  warmup_time: 0.002938985824584961
  
Result for objective_09e21122:
  date: 2022-07-22_15-24-59
  done: false
  experiment_id: 0a825198482b4bd4aded6c318dff0dcf
  hostname: Kais-MacBook-Pro.local
  iterations: 93
  iterations_since_restore: 94
  mean_loss: 14.23411049568083
  neg_mean_loss: -14.23411049568083
  node_ip: 127.0.0.1
  pid: 46526
  time_since_restore: 10.066343307495117
  time_this_iter_s: 0.1061861515045166
  time_total_s: 10.066343307495117
  timestamp: 1658499899
  timesteps_since_restore: 0
  training_iteration: 94
  trial_id: 09e21122
  warmup_time: 0.003228902816772461
  
Result for objective_09e0846a:
  date: 2022-07-22_15-24-59
  done: false
  experiment_id: 260410fc1fb24f78af507cd38a8361a9
  hostname: Kais-MacBook-Pro.local
  iterations: 93
  iterations_since_restore: 94
  mean_loss: 6.2890729561522765
  neg_mean_loss: -6.2890729561522765
  node_ip: 127.0.0.1
  pid: 46525
  time_since_restore: 10.100499868392944
  time_this_iter_s: 0.10625505447387695
  time_total_s: 10.100499868392944
  timestamp: 1658499899
  timesteps_since_restore: 0
  training_iteration: 94
  trial_id: 09e0846a
  warmup_time: 0.002719879150390625
  
Result for objective_1045958e:
  date: 2022-07-22_15-25-00
  done: false
  experiment_id: 3579bfc2b346424b833f82f23d459807
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 12.671822501738296
  neg_mean_loss: -12.671822501738296
  node_ip: 127.0.0.1
  pid: 46544
  time_since_restore: 0.10491013526916504
  time_this_iter_s: 0.10491013526916504
  time_total_s: 0.10491013526916504
  timestamp: 1658499900
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 1045958e
  warmup_time: 0.002847909927368164
  
Result for objective_09dee4f2:
  date: 2022-07-22_15-25-01
  done: true
  experiment_id: 9469ffc8df11476db00e329acd2ae8b6
  experiment_tag: 2_activation=tanh,height=-44.4216,steps=100,width=12.9653
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -3.3648509190285747
  neg_mean_loss: 3.3648509190285747
  node_ip: 127.0.0.1
  pid: 46524
  time_since_restore: 11.347625017166138
  time_this_iter_s: 0.10793185234069824
  time_total_s: 11.347625017166138
  timestamp: 1658499901
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 09dee4f2
  warmup_time: 0.002938985824584961
  
Result for objective_09e0846a:
  date: 2022-07-22_15-25-01
  done: true
  experiment_id: 260410fc1fb24f78af507cd38a8361a9
  experiment_tag: 3_activation=relu,height=-38.0638,steps=100,width=11.1574
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 6.28333982260153
  neg_mean_loss: -6.28333982260153
  node_ip: 127.0.0.1
  pid: 46525
  time_since_restore: 11.310342788696289
  time_this_iter_s: 0.10942316055297852
  time_total_s: 11.310342788696289
  timestamp: 1658499901
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 09e0846a
  warmup_time: 0.002719879150390625
  
Result for objective_09e21122:
  date: 2022-07-22_15-25-01
  done: true
  experiment_id: 0a825198482b4bd4aded6c318dff0dcf
  experiment_tag: 4_activation=relu,height=41.2509,steps=100,width=9.7559
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 14.22757115653867
  neg_mean_loss: -14.22757115653867
  node_ip: 127.0.0.1
  pid: 46526
  time_since_restore: 11.351194143295288
  time_this_iter_s: 0.10791015625
  time_total_s: 11.351194143295288
  timestamp: 1658499901
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 09e21122
  warmup_time: 0.003228902816772461
  

Result for objective_12309db2:
  date: 2022-07-22_15-25-03
  done: false
  experiment_id: 3915d19b775c4ee1843b5dcf79560a93
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 10.503337773185708
  neg_mean_loss: -10.503337773185708
  node_ip: 127.0.0.1
  pid: 46549
  time_since_restore: 0.10407328605651855
  time_this_iter_s: 0.10407328605651855
  time_total_s: 0.10407328605651855
  timestamp: 1658499903
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 12309db2
  warmup_time: 0.0030128955841064453
  
Result for objective_12342770:
  date: 2022-07-22_15-25-03
  done: false
  experiment_id: 1da16f0c20d7438b93927280dc40e5a1
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 1.1922491879354844
  neg_mean_loss: -1.1922491879354844
  node_ip: 127.0.0.1
  pid: 46550
  time_since_restore: 0.1050269603729248
  time_this_iter_s: 0.1050269603729248
  time_total_s: 0.1050269603729248
  timestamp: 1658499903
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '12342770'
  warmup_time: 0.0032460689544677734
  
Result for objective_12374d7e:
  date: 2022-07-22_15-25-03
  done: false
  experiment_id: 5788d010ee194eeeabfc3592d37fb2cc
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 19.839240921278268
  neg_mean_loss: -19.839240921278268
  node_ip: 127.0.0.1
  pid: 46551
  time_since_restore: 0.10313534736633301
  time_this_iter_s: 0.10313534736633301
  time_total_s: 0.10313534736633301
  timestamp: 1658499903
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 12374d7e
  warmup_time: 0.002891063690185547
  
Result for objective_1045958e:
  date: 2022-07-22_15-25-05
  done: false
  experiment_id: 3579bfc2b346424b833f82f23d459807
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 3.0263684682219036
  neg_mean_loss: -3.0263684682219036
  node_ip: 127.0.0.1
  pid: 46544
  time_since_restore: 5.180821180343628
  time_this_iter_s: 0.10701394081115723
  time_total_s: 5.180821180343628
  timestamp: 1658499905
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 1045958e
  warmup_time: 0.002847909927368164
  
Result for objective_12309db2:
  date: 2022-07-22_15-25-08
  done: false
  experiment_id: 3915d19b775c4ee1843b5dcf79560a93
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 0.6271166903395393
  neg_mean_loss: -0.6271166903395393
  node_ip: 127.0.0.1
  pid: 46549
  time_since_restore: 5.172047138214111
  time_this_iter_s: 0.11187624931335449
  time_total_s: 5.172047138214111
  timestamp: 1658499908
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 12309db2
  warmup_time: 0.0030128955841064453
  
Result for objective_12342770:
  date: 2022-07-22_15-25-08
  done: false
  experiment_id: 1da16f0c20d7438b93927280dc40e5a1
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -8.685737519988487
  neg_mean_loss: 8.685737519988487
  node_ip: 127.0.0.1
  pid: 46550
  time_since_restore: 5.172597885131836
  time_this_iter_s: 0.10711097717285156
  time_total_s: 5.172597885131836
  timestamp: 1658499908
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: '12342770'
  warmup_time: 0.0032460689544677734
  
Result for objective_12374d7e:
  date: 2022-07-22_15-25-08
  done: false
  experiment_id: 5788d010ee194eeeabfc3592d37fb2cc
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 9.955526689542863
  neg_mean_loss: -9.955526689542863
  node_ip: 127.0.0.1
  pid: 46551
  time_since_restore: 5.162422180175781
  time_this_iter_s: 0.10872411727905273
  time_total_s: 5.162422180175781
  timestamp: 1658499908
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 12374d7e
  warmup_time: 0.002891063690185547
  
Result for objective_1045958e:
  date: 2022-07-22_15-25-10
  done: false
  experiment_id: 3579bfc2b346424b833f82f23d459807
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 2.852294770731789
  neg_mean_loss: -2.852294770731789
  node_ip: 127.0.0.1
  pid: 46544
  time_since_restore: 10.196197271347046
  time_this_iter_s: 0.10780715942382812
  time_total_s: 10.196197271347046
  timestamp: 1658499910
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: 1045958e
  warmup_time: 0.002847909927368164
  
Result for objective_1045958e:
  date: 2022-07-22_15-25-11
  done: true
  experiment_id: 3579bfc2b346424b833f82f23d459807
  experiment_tag: 5_activation=relu,height=-73.2818,steps=100,width=5.7883
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 2.8433363404373386
  neg_mean_loss: -2.8433363404373386
  node_ip: 127.0.0.1
  pid: 46544
  time_since_restore: 10.737220287322998
  time_this_iter_s: 0.10835909843444824
  time_total_s: 10.737220287322998
  timestamp: 1658499911
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 1045958e
  warmup_time: 0.002847909927368164
  
Result for objective_18344524:
  date: 2022-07-22_15-25-13
  done: false
  experiment_id: 10740ef080664baaa8cca7ba5cb899ac
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 6.887162536491742
  neg_mean_loss: -6.887162536491742
  node_ip: 127.0.0.1
  pid: 46569
  time_since_restore: 0.10450887680053711
  time_this_iter_s: 0.10450887680053711
  time_total_s: 0.10450887680053711
  timestamp: 1658499913
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '18344524'
  warmup_time: 0.002858877182006836
  
Result for objective_12309db2:
  date: 2022-07-22_15-25-13
  done: false
  experiment_id: 3915d19b775c4ee1843b5dcf79560a93
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 0.5656126475885976
  neg_mean_loss: -0.5656126475885976
  node_ip: 127.0.0.1
  pid: 46549
  time_since_restore: 10.193128108978271
  time_this_iter_s: 0.10602211952209473
  time_total_s: 10.193128108978271
  timestamp: 1658499913
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: 12309db2
  warmup_time: 0.0030128955841064453
  
Result for objective_12342770:
  date: 2022-07-22_15-25-13
  done: false
  experiment_id: 1da16f0c20d7438b93927280dc40e5a1
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: -8.746369700451542
  neg_mean_loss: 8.746369700451542
  node_ip: 127.0.0.1
  pid: 46550
  time_since_restore: 10.210996866226196
  time_this_iter_s: 0.10719585418701172
  time_total_s: 10.210996866226196
  timestamp: 1658499913
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: '12342770'
  warmup_time: 0.0032460689544677734
  
Result for objective_12374d7e:
  date: 2022-07-22_15-25-13
  done: false
  experiment_id: 5788d010ee194eeeabfc3592d37fb2cc
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 9.897723841978765
  neg_mean_loss: -9.897723841978765
  node_ip: 127.0.0.1
  pid: 46551
  time_since_restore: 10.19912338256836
  time_this_iter_s: 0.10725522041320801
  time_total_s: 10.19912338256836
  timestamp: 1658499913
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: 12374d7e
  warmup_time: 0.002891063690185547
  
Result for objective_12309db2:
  date: 2022-07-22_15-25-14
  done: true
  experiment_id: 3915d19b775c4ee1843b5dcf79560a93
  experiment_tag: 6_activation=relu,height=-94.9666,steps=100,width=16.9764
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 0.5624860552037738
  neg_mean_loss: -0.5624860552037738
  node_ip: 127.0.0.1
  pid: 46549
  time_since_restore: 10.73293399810791
  time_this_iter_s: 0.1079857349395752
  time_total_s: 10.73293399810791
  timestamp: 1658499914
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 12309db2
  warmup_time: 0.0030128955841064453
  
Result for objective_12342770:
  date: 2022-07-22_15-25-14
  done: true
  experiment_id: 1da16f0c20d7438b93927280dc40e5a1
  experiment_tag: 7_activation=tanh,height=-98.0775,steps=100,width=17.2252
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -8.749451683536464
  neg_mean_loss: 8.749451683536464
  node_ip: 127.0.0.1
  pid: 46550
  time_since_restore: 10.745534181594849
  time_this_iter_s: 0.10716795921325684
  time_total_s: 10.745534181594849
  timestamp: 1658499914
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: '12342770'
  warmup_time: 0.0032460689544677734
  
Result for objective_12374d7e:
  date: 2022-07-22_15-25-14
  done: true
  experiment_id: 5788d010ee194eeeabfc3592d37fb2cc
  experiment_tag: 8_activation=relu,height=-1.6076,steps=100,width=18.0841
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 9.894786565536863
  neg_mean_loss: -9.894786565536863
  node_ip: 127.0.0.1
  pid: 46551
  time_since_restore: 10.734816074371338
  time_this_iter_s: 0.10638594627380371
  time_total_s: 10.734816074371338
  timestamp: 1658499914
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 12374d7e
  warmup_time: 0.002891063690185547
  

Result for objective_1a1e29b8:
  date: 2022-07-22_15-25-17
  done: false
  experiment_id: 26fc8c5f05a6407690dc8cada561576e
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 17.40289288319415
  neg_mean_loss: -17.40289288319415
  node_ip: 127.0.0.1
  pid: 46576
  time_since_restore: 0.10475707054138184
  time_this_iter_s: 0.10475707054138184
  time_total_s: 0.10475707054138184
  timestamp: 1658499917
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 1a1e29b8
  warmup_time: 0.0028810501098632812
  
Result for objective_18344524:
  date: 2022-07-22_15-25-19
  done: false
  experiment_id: 10740ef080664baaa8cca7ba5cb899ac
  hostname: Kais-MacBook-Pro.local
  iterations: 30
  iterations_since_restore: 31
  mean_loss: -2.8488858516331668
  neg_mean_loss: 2.8488858516331668
  node_ip: 127.0.0.1
  pid: 46569
  time_since_restore: 5.212157964706421
  time_this_iter_s: 0.10646200180053711
  time_total_s: 5.212157964706421
  timestamp: 1658499919
  timesteps_since_restore: 0
  training_iteration: 31
  trial_id: '18344524'
  warmup_time: 0.002858877182006836
  
Result for objective_1a1e29b8:
  date: 2022-07-22_15-25-22
  done: false
  experiment_id: 26fc8c5f05a6407690dc8cada561576e
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 7.610248309424407
  neg_mean_loss: -7.610248309424407
  node_ip: 127.0.0.1
  pid: 46576
  time_since_restore: 5.170850038528442
  time_this_iter_s: 0.1072230339050293
  time_total_s: 5.170850038528442
  timestamp: 1658499922
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: 1a1e29b8
  warmup_time: 0.0028810501098632812
  
Result for objective_18344524:
  date: 2022-07-22_15-25-24
  done: false
  experiment_id: 10740ef080664baaa8cca7ba5cb899ac
  hostname: Kais-MacBook-Pro.local
  iterations: 77
  iterations_since_restore: 78
  mean_loss: -3.0083151799393004
  neg_mean_loss: 3.0083151799393004
  node_ip: 127.0.0.1
  pid: 46569
  time_since_restore: 10.263540983200073
  time_this_iter_s: 0.10780215263366699
  time_total_s: 10.263540983200073
  timestamp: 1658499924
  timesteps_since_restore: 0
  training_iteration: 78
  trial_id: '18344524'
  warmup_time: 0.002858877182006836
  
Result for objective_18344524:
  date: 2022-07-22_15-25-26
  done: true
  experiment_id: 10740ef080664baaa8cca7ba5cb899ac
  experiment_tag: 9_activation=tanh,height=-41.1284,steps=100,width=12.2952
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -3.0313530888899516
  neg_mean_loss: 3.0313530888899516
  node_ip: 127.0.0.1
  pid: 46569
  time_since_restore: 12.62198805809021
  time_this_iter_s: 0.1080331802368164
  time_total_s: 12.62198805809021
  timestamp: 1658499926
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: '18344524'
  warmup_time: 0.002858877182006836
  
Result for objective_1a1e29b8:
  date: 2022-07-22_15-25-27
  done: false
  experiment_id: 26fc8c5f05a6407690dc8cada561576e
  hostname: Kais-MacBook-Pro.local
  iterations: 93
  iterations_since_restore: 94
  mean_loss: 7.5087713304782575
  neg_mean_loss: -7.5087713304782575
  node_ip: 127.0.0.1
  pid: 46576
  time_since_restore: 10.177540063858032
  time_this_iter_s: 0.1076350212097168
  time_total_s: 10.177540063858032
  timestamp: 1658499927
  timesteps_since_restore: 0
  training_iteration: 94
  trial_id: 1a1e29b8
  warmup_time: 0.0028810501098632812
  
Result for objective_1a1e29b8:
  date: 2022-07-22_15-25-27
  done: true
  experiment_id: 26fc8c5f05a6407690dc8cada561576e
  experiment_tag: 10_activation=tanh,height=64.0289,steps=100,width=10.0482
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 7.502418319119348
  neg_mean_loss: -7.502418319119348
  node_ip: 127.0.0.1
  pid: 46576
  time_since_restore: 10.823745012283325
  time_this_iter_s: 0.10851097106933594
  time_total_s: 10.823745012283325
  timestamp: 1658499927
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: 1a1e29b8
  warmup_time: 0.0028810501098632812
  

INFO:ray.tune.tune:Total run time: 43.33 seconds (43.21 seconds for the tuning loop).

以下是找到的最小化定义目标平均损失的超参数。请注意，由于我们在 TuneConfig 中未设置指标和模式，此处必须传递它们。

print("Best hyperparameters found were: ", results.get_best_result("mean_loss", "min").config)

Best hyperparameters found were:  {'steps': 100, 'width': 17.225166732233465, 'height': -98.07750812064515, 'activation': 'tanh'}