使用 BayesOpt 运行 Tune 实验

在本教程中，我们将介绍 BayesOpt，同时运行一个简单的 Ray Tune 实验。Tune 的搜索算法与 BayesOpt 集成，因此您可以无缝扩展 BayesOpt 优化过程 - 而不会牺牲性能。

BayesOpt 是一个利用高斯过程上的贝叶斯推理进行约束全局优化的软件包，重点在于在尽可能少的迭代次数内找到未知函数的最大值。BayesOpt 的技术特别适用于高成本函数的优化，以及探索与利用平衡至关重要的情况。因此，BayesOpt 属于“无导数”和“黑盒”优化的范畴。在本例中，我们通过 BayesOptSearch 最小化一个简单目标，简要演示 BayesOpt 与 Ray Tune 的用法，包括条件搜索空间。请注意，尽管重点在于机器学习实验，Ray Tune 优化的是任何隐式或显式目标。这里我们假设已安装 bayesian-optimization==1.2.0 库。要了解更多信息，请参考 BayesOpt 网站。

首先，安装本示例的预备条件。

!pip install -q bayesian-optimization==1.2.0 "ray[tune]"

点击下方查看本示例所需的所有导入项。

显示代码单元源 隐藏代码单元源

import time

import ray
from ray import tune
from ray.tune.search import ConcurrencyLimiter
from ray.tune.search.bayesopt import BayesOptSearch

让我们首先定义一个简单的评估函数。我们人为地暂停了一会儿 (0.1 秒) 来模拟一个长时间运行的机器学习实验。此设置假定我们正在运行实验的多个 step，并尝试调优两个超参数，即 width 和 height。

def evaluate(step, width, height):
    time.sleep(0.1)
    return (0.1 + width * step / 100) ** (-1) + height * 0.1

接下来，我们的 objective 函数接受一个 Tune config，在训练循环中评估实验的 score，并使用 tune.report 将 score 报告回 Tune。

def objective(config):
    for step in range(config["steps"]):
        score = evaluate(step, config["width"], config["height"])
        tune.report({"iterations": step, "mean_loss": score})

现在我们定义由 BayesOptSearch 构建的搜索算法，并通过 ConcurrencyLimiter 将并发 trial 限制为最多 4 个。

algo = BayesOptSearch(utility_kwargs={"kind": "ucb", "kappa": 2.5, "xi": 0.0})
algo = ConcurrencyLimiter(algo, max_concurrent=4)

样本数是要尝试的超参数组合的数量。此 Tune 运行设置为 1000 个样本（如果您的机器运行时间过长，可以减少此数量）。

num_samples = 1000

接下来我们定义搜索空间。关键假设是最优超参数位于此空间内。然而，如果空间非常大，则可能很难在短时间内找到这些超参数。

search_space = {
    "steps": 100,
    "width": tune.uniform(0, 20),
    "height": tune.uniform(-100, 100),
}

最后，我们运行实验，通过 algo 搜索 search_config，执行 num_samples 次，以 "min" 化 objective 的“mean_loss”。前一句话完整描述了我们旨在解决的搜索问题。记住这一点，注意执行 tuner.fit() 的效率。

tuner = tune.Tuner(
    objective,
    tune_config=tune.TuneConfig(
        metric="mean_loss",
        mode="min",
        search_alg=algo,
        num_samples=num_samples,
    ),
    param_space=search_space,
)
results = tuner.fit()

== 状态 ==
当前时间: 2022-07-22 15:30:53 (运行时间 00:00:43.91)
此节点内存使用量: 10.4/16.0 GiB
正在使用 FIFO 调度算法。
请求资源: 0/16 CPU, 0/0 GPU, 0.0/4.47 GiB 堆内存, 0.0/2.0 GiB 对象内存
当前最佳 trial: d42ac71c 损失均值 -9.536507956046009 参数为 {'steps': 100, 'width': 19.398197043239886, 'height': -95.88310114083951}
结果日志目录: /Users/kai/ray_results/objective_2022-07-22_15-30-08
Trial 数量: 10/10 (10 已终止)

Trial 名称	状态	位置	高度	宽度	损失	迭代	总时间 (s)	迭代次数	负损失均值
objective_c9daa5d4	已终止	127.0.0.1:46960	-25.092	19.0143	-2.45636	100	10.9865	99	2.45636
objective_cb9bc830	已终止	127.0.0.1:46968	46.3988	11.9732	4.72354	100	11.5661	99	-4.72354
objective_cb9d338c	已终止	127.0.0.1:46969	-68.7963	3.11989	-6.56602	100	11.648	99	6.56602
objective_cb9e97e0	已终止	127.0.0.1:46970	-88.3833	17.3235	-8.78036	100	11.6948	99	8.78036
objective_d229961e	已终止	127.0.0.1:47009	20.223	14.1615	2.09312	100	10.8549	99	-2.09312
objective_d42ac71c	已终止	127.0.0.1:47036	-95.8831	19.3982	-9.53651	100	10.7931	99	9.53651
objective_d43ca61c	已终止	127.0.0.1:47039	66.4885	4.24678	6.88118	100	10.7606	99	-6.88118
objective_d43fb190	已终止	127.0.0.1:47040	-63.635	3.66809	-6.09551	100	10.7997	99	6.09551
objective_da1ff46c	已终止	127.0.0.1:47057	-39.1516	10.4951	-3.81983	100	10.7762	99	3.81983
objective_dc25c796	已终止	127.0.0.1:47062	-13.611	5.82458	-1.19064	100	10.7213	99	1.19064

Result for objective_c9daa5d4:
  date: 2022-07-22_15-30-12
  done: false
  experiment_id: 422a6d2a512a470480e33913d7825a7a
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 7.490802376947249
  neg_mean_loss: -7.490802376947249
  node_ip: 127.0.0.1
  pid: 46960
  time_since_restore: 0.1042318344116211
  time_this_iter_s: 0.1042318344116211
  time_total_s: 0.1042318344116211
  timestamp: 1658500212
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: c9daa5d4
  warmup_time: 0.0032601356506347656
  
Result for objective_cb9bc830:
  date: 2022-07-22_15-30-15
  done: false
  experiment_id: 3a9a6bef89ec4b57bd0fa24dd3b407e6
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 14.639878836228101
  neg_mean_loss: -14.639878836228101
  node_ip: 127.0.0.1
  pid: 46968
  time_since_restore: 0.10442280769348145
  time_this_iter_s: 0.10442280769348145
  time_total_s: 0.10442280769348145
  timestamp: 1658500215
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: cb9bc830
  warmup_time: 0.0038840770721435547
  
Result for objective_cb9e97e0:
  date: 2022-07-22_15-30-15
  done: false
  experiment_id: b0266e323ced4991b155344b34c25c59
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 1.1616722433639897
  neg_mean_loss: -1.1616722433639897
  node_ip: 127.0.0.1
  pid: 46970
  time_since_restore: 0.10328483581542969
  time_this_iter_s: 0.10328483581542969
  time_total_s: 0.10328483581542969
  timestamp: 1658500215
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: cb9e97e0
  warmup_time: 0.004090070724487305
  
Result for objective_cb9d338c:
  date: 2022-07-22_15-30-15
  done: false
  experiment_id: 2731a83e40eb468fb79e19f872b8f597
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 3.120372808848731
  neg_mean_loss: -3.120372808848731
  node_ip: 127.0.0.1
  pid: 46969
  time_since_restore: 0.1042470932006836
  time_this_iter_s: 0.1042470932006836
  time_total_s: 0.1042470932006836
  timestamp: 1658500215
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: cb9d338c
  warmup_time: 0.003387928009033203
  
Result for objective_c9daa5d4:
  date: 2022-07-22_15-30-17
  done: false
  experiment_id: 422a6d2a512a470480e33913d7825a7a
  hostname: Kais-MacBook-Pro.local
  iterations: 45
  iterations_since_restore: 46
  mean_loss: -2.393676542940848
  neg_mean_loss: 2.393676542940848
  node_ip: 127.0.0.1
  pid: 46960
  time_since_restore: 5.1730430126190186
  time_this_iter_s: 0.10674905776977539
  time_total_s: 5.1730430126190186
  timestamp: 1658500217
  timesteps_since_restore: 0
  training_iteration: 46
  trial_id: c9daa5d4
  warmup_time: 0.0032601356506347656
  
Result for objective_cb9bc830:
  date: 2022-07-22_15-30-20
  done: false
  experiment_id: 3a9a6bef89ec4b57bd0fa24dd3b407e6
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 4.8144784432736065
  neg_mean_loss: -4.8144784432736065
  node_ip: 127.0.0.1
  pid: 46968
  time_since_restore: 5.1083409786224365
  time_this_iter_s: 0.10834097862243652
  time_total_s: 5.1083409786224365
  timestamp: 1658500220
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: cb9bc830
  warmup_time: 0.0038840770721435547
  
Result for objective_cb9e97e0:
  date: 2022-07-22_15-30-20
  done: false
  experiment_id: b0266e323ced4991b155344b34c25c59
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -8.716998803293404
  neg_mean_loss: 8.716998803293404
  node_ip: 127.0.0.1
  pid: 46970
  time_since_restore: 5.117117881774902
  time_this_iter_s: 0.10473918914794922
  time_total_s: 5.117117881774902
  timestamp: 1658500220
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: cb9e97e0
  warmup_time: 0.004090070724487305
  
Result for objective_cb9d338c:
  date: 2022-07-22_15-30-20
  done: false
  experiment_id: 2731a83e40eb468fb79e19f872b8f597
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -6.241199660085543
  neg_mean_loss: 6.241199660085543
  node_ip: 127.0.0.1
  pid: 46969
  time_since_restore: 5.1075780391693115
  time_this_iter_s: 0.1051321029663086
  time_total_s: 5.1075780391693115
  timestamp: 1658500220
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: cb9d338c
  warmup_time: 0.003387928009033203
  
Result for objective_c9daa5d4:
  date: 2022-07-22_15-30-22
  done: false
  experiment_id: 422a6d2a512a470480e33913d7825a7a
  hostname: Kais-MacBook-Pro.local
  iterations: 92
  iterations_since_restore: 93
  mean_loss: -2.452357296882761
  neg_mean_loss: 2.452357296882761
  node_ip: 127.0.0.1
  pid: 46960
  time_since_restore: 10.23116397857666
  time_this_iter_s: 0.10653018951416016
  time_total_s: 10.23116397857666
  timestamp: 1658500222
  timesteps_since_restore: 0
  training_iteration: 93
  trial_id: c9daa5d4
  warmup_time: 0.0032601356506347656
  
Result for objective_c9daa5d4:
  date: 2022-07-22_15-30-23
  done: true
  experiment_id: 422a6d2a512a470480e33913d7825a7a
  experiment_tag: 1_height=-25.0920,steps=100,width=19.0143
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -2.456355072354658
  neg_mean_loss: 2.456355072354658
  node_ip: 127.0.0.1
  pid: 46960
  time_since_restore: 10.986503839492798
  time_this_iter_s: 0.10757803916931152
  time_total_s: 10.986503839492798
  timestamp: 1658500223
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: c9daa5d4
  warmup_time: 0.0032601356506347656
  
Result for objective_cb9bc830:
  date: 2022-07-22_15-30-24
  done: false
  experiment_id: 3a9a6bef89ec4b57bd0fa24dd3b407e6
  hostname: Kais-MacBook-Pro.local
  iterations: 91
  iterations_since_restore: 92
  mean_loss: 4.73082443425139
  neg_mean_loss: -4.73082443425139
  node_ip: 127.0.0.1
  pid: 46968
  time_since_restore: 9.829612970352173
  time_this_iter_s: 0.10725593566894531
  time_total_s: 9.829612970352173
  timestamp: 1658500224
  timesteps_since_restore: 0
  training_iteration: 92
  trial_id: cb9bc830
  warmup_time: 0.0038840770721435547
  
Result for objective_cb9e97e0:
  date: 2022-07-22_15-30-24
  done: false
  experiment_id: b0266e323ced4991b155344b34c25c59
  hostname: Kais-MacBook-Pro.local
  iterations: 90
  iterations_since_restore: 91
  mean_loss: -8.774597648541096
  neg_mean_loss: 8.774597648541096
  node_ip: 127.0.0.1
  pid: 46970
  time_since_restore: 9.72621202468872
  time_this_iter_s: 0.10692906379699707
  time_total_s: 9.72621202468872
  timestamp: 1658500224
  timesteps_since_restore: 0
  training_iteration: 91
  trial_id: cb9e97e0
  warmup_time: 0.004090070724487305
  
Result for objective_cb9d338c:
  date: 2022-07-22_15-30-24
  done: false
  experiment_id: 2731a83e40eb468fb79e19f872b8f597
  hostname: Kais-MacBook-Pro.local
  iterations: 90
  iterations_since_restore: 91
  mean_loss: -6.535736572413468
  neg_mean_loss: 6.535736572413468
  node_ip: 127.0.0.1
  pid: 46969
  time_since_restore: 9.71235203742981
  time_this_iter_s: 0.10665416717529297
  time_total_s: 9.71235203742981
  timestamp: 1658500224
  timesteps_since_restore: 0
  training_iteration: 91
  trial_id: cb9d338c
  warmup_time: 0.003387928009033203
  
Result for objective_d229961e:
  date: 2022-07-22_15-30-25
  done: false
  experiment_id: d8bb04569c644d6fabad5064c1828ba3
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 12.022300234864176
  neg_mean_loss: -12.022300234864176
  node_ip: 127.0.0.1
  pid: 47009
  time_since_restore: 0.1041719913482666
  time_this_iter_s: 0.1041719913482666
  time_total_s: 0.1041719913482666
  timestamp: 1658500225
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: d229961e
  warmup_time: 0.003198862075805664
  
Result for objective_cb9bc830:
  date: 2022-07-22_15-30-26
  done: true
  experiment_id: 3a9a6bef89ec4b57bd0fa24dd3b407e6
  experiment_tag: 2_height=46.3988,steps=100,width=11.9732
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 4.723536776402224
  neg_mean_loss: -4.723536776402224
  node_ip: 127.0.0.1
  pid: 46968
  time_since_restore: 11.566141843795776
  time_this_iter_s: 0.10738396644592285
  time_total_s: 11.566141843795776
  timestamp: 1658500226
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: cb9bc830
  warmup_time: 0.0038840770721435547
  
Result for objective_cb9d338c:
  date: 2022-07-22_15-30-26
  done: true
  experiment_id: 2731a83e40eb468fb79e19f872b8f597
  experiment_tag: 3_height=-68.7963,steps=100,width=3.1199
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -6.566018929214734
  neg_mean_loss: 6.566018929214734
  node_ip: 127.0.0.1
  pid: 46969
  time_since_restore: 11.647998809814453
  time_this_iter_s: 0.1123647689819336
  time_total_s: 11.647998809814453
  timestamp: 1658500226
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: cb9d338c
  warmup_time: 0.003387928009033203
  
Result for objective_cb9e97e0:
  date: 2022-07-22_15-30-26
  done: true
  experiment_id: b0266e323ced4991b155344b34c25c59
  experiment_tag: 4_height=-88.3833,steps=100,width=17.3235
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -8.780357708936942
  neg_mean_loss: 8.780357708936942
  node_ip: 127.0.0.1
  pid: 46970
  time_since_restore: 11.694752931594849
  time_this_iter_s: 0.12678027153015137
  time_total_s: 11.694752931594849
  timestamp: 1658500226
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: cb9e97e0
  warmup_time: 0.004090070724487305
  

Result for objective_d42ac71c:
  date: 2022-07-22_15-30-29
  done: false
  experiment_id: 3fdfaecb7adc4c5cb54c0aa76849d532
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 0.41168988591604894
  neg_mean_loss: -0.41168988591604894
  node_ip: 127.0.0.1
  pid: 47036
  time_since_restore: 0.10324597358703613
  time_this_iter_s: 0.10324597358703613
  time_total_s: 0.10324597358703613
  timestamp: 1658500229
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: d42ac71c
  warmup_time: 0.0028409957885742188
  
Result for objective_d43ca61c:
  date: 2022-07-22_15-30-29
  done: false
  experiment_id: 8f92f519ea5443be9efd6f4a8937b8ee
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 16.648852816008436
  neg_mean_loss: -16.648852816008436
  node_ip: 127.0.0.1
  pid: 47039
  time_since_restore: 0.10412001609802246
  time_this_iter_s: 0.10412001609802246
  time_total_s: 0.10412001609802246
  timestamp: 1658500229
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: d43ca61c
  warmup_time: 0.002924203872680664
  
Result for objective_d43fb190:
  date: 2022-07-22_15-30-29
  done: false
  experiment_id: 18283da742c74042ad3db1846fa7b460
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 3.6364993441420124
  neg_mean_loss: -3.6364993441420124
  node_ip: 127.0.0.1
  pid: 47040
  time_since_restore: 0.10391902923583984
  time_this_iter_s: 0.10391902923583984
  time_total_s: 0.10391902923583984
  timestamp: 1658500229
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: d43fb190
  warmup_time: 0.0027680397033691406
  
Result for objective_d229961e:
  date: 2022-07-22_15-30-30
  done: false
  experiment_id: d8bb04569c644d6fabad5064c1828ba3
  hostname: Kais-MacBook-Pro.local
  iterations: 46
  iterations_since_restore: 47
  mean_loss: 2.1734885512401174
  neg_mean_loss: -2.1734885512401174
  node_ip: 127.0.0.1
  pid: 47009
  time_since_restore: 5.153247117996216
  time_this_iter_s: 0.10638809204101562
  time_total_s: 5.153247117996216
  timestamp: 1658500230
  timesteps_since_restore: 0
  training_iteration: 47
  trial_id: d229961e
  warmup_time: 0.003198862075805664
  
Result for objective_d42ac71c:
  date: 2022-07-22_15-30-34
  done: false
  experiment_id: 3fdfaecb7adc4c5cb54c0aa76849d532
  hostname: Kais-MacBook-Pro.local
  iterations: 46
  iterations_since_restore: 47
  mean_loss: -9.477484325687673
  neg_mean_loss: 9.477484325687673
  node_ip: 127.0.0.1
  pid: 47036
  time_since_restore: 5.123893976211548
  time_this_iter_s: 0.10898423194885254
  time_total_s: 5.123893976211548
  timestamp: 1658500234
  timesteps_since_restore: 0
  training_iteration: 47
  trial_id: d42ac71c
  warmup_time: 0.0028409957885742188
  
Result for objective_d43ca61c:
  date: 2022-07-22_15-30-34
  done: false
  experiment_id: 8f92f519ea5443be9efd6f4a8937b8ee
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: 7.12595486600941
  neg_mean_loss: -7.12595486600941
  node_ip: 127.0.0.1
  pid: 47039
  time_since_restore: 5.194939136505127
  time_this_iter_s: 0.10889291763305664
  time_total_s: 5.194939136505127
  timestamp: 1658500234
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: d43ca61c
  warmup_time: 0.002924203872680664
  
Result for objective_d43fb190:
  date: 2022-07-22_15-30-34
  done: false
  experiment_id: 18283da742c74042ad3db1846fa7b460
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -5.815255760980219
  neg_mean_loss: 5.815255760980219
  node_ip: 127.0.0.1
  pid: 47040
  time_since_restore: 5.2366979122161865
  time_this_iter_s: 0.10901784896850586
  time_total_s: 5.2366979122161865
  timestamp: 1658500234
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: d43fb190
  warmup_time: 0.0027680397033691406
  
Result for objective_d229961e:
  date: 2022-07-22_15-30-35
  done: false
  experiment_id: d8bb04569c644d6fabad5064c1828ba3
  hostname: Kais-MacBook-Pro.local
  iterations: 93
  iterations_since_restore: 94
  mean_loss: 2.097657333615391
  neg_mean_loss: -2.097657333615391
  node_ip: 127.0.0.1
  pid: 47009
  time_since_restore: 10.209784984588623
  time_this_iter_s: 0.10757803916931152
  time_total_s: 10.209784984588623
  timestamp: 1658500235
  timesteps_since_restore: 0
  training_iteration: 94
  trial_id: d229961e
  warmup_time: 0.003198862075805664
  
Result for objective_d229961e:
  date: 2022-07-22_15-30-36
  done: true
  experiment_id: d8bb04569c644d6fabad5064c1828ba3
  experiment_tag: 5_height=20.2230,steps=100,width=14.1615
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 2.093122581973529
  neg_mean_loss: -2.093122581973529
  node_ip: 127.0.0.1
  pid: 47009
  time_since_restore: 10.854872226715088
  time_this_iter_s: 0.10703516006469727
  time_total_s: 10.854872226715088
  timestamp: 1658500236
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: d229961e
  warmup_time: 0.003198862075805664
  
Result for objective_da1ff46c:
  date: 2022-07-22_15-30-39
  done: false
  experiment_id: 9163132451a14ace8ddf394aeaae9018
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 6.0848448591907545
  neg_mean_loss: -6.0848448591907545
  node_ip: 127.0.0.1
  pid: 47057
  time_since_restore: 0.10405993461608887
  time_this_iter_s: 0.10405993461608887
  time_total_s: 0.10405993461608887
  timestamp: 1658500239
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: da1ff46c
  warmup_time: 0.0030031204223632812
  
Result for objective_d42ac71c:
  date: 2022-07-22_15-30-39
  done: false
  experiment_id: 3fdfaecb7adc4c5cb54c0aa76849d532
  hostname: Kais-MacBook-Pro.local
  iterations: 93
  iterations_since_restore: 94
  mean_loss: -9.533184304791206
  neg_mean_loss: 9.533184304791206
  node_ip: 127.0.0.1
  pid: 47036
  time_since_restore: 10.145818948745728
  time_this_iter_s: 0.10763311386108398
  time_total_s: 10.145818948745728
  timestamp: 1658500239
  timesteps_since_restore: 0
  training_iteration: 94
  trial_id: d42ac71c
  warmup_time: 0.0028409957885742188
  
Result for objective_d43ca61c:
  date: 2022-07-22_15-30-39
  done: false
  experiment_id: 8f92f519ea5443be9efd6f4a8937b8ee
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: 6.893233568918634
  neg_mean_loss: -6.893233568918634
  node_ip: 127.0.0.1
  pid: 47039
  time_since_restore: 10.217039108276367
  time_this_iter_s: 0.10719418525695801
  time_total_s: 10.217039108276367
  timestamp: 1658500239
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: d43ca61c
  warmup_time: 0.002924203872680664
  
Result for objective_d43fb190:
  date: 2022-07-22_15-30-39
  done: false
  experiment_id: 18283da742c74042ad3db1846fa7b460
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: -6.08165210701758
  neg_mean_loss: 6.08165210701758
  node_ip: 127.0.0.1
  pid: 47040
  time_since_restore: 10.262099027633667
  time_this_iter_s: 0.10874485969543457
  time_total_s: 10.262099027633667
  timestamp: 1658500239
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: d43fb190
  warmup_time: 0.0027680397033691406
  
Result for objective_d42ac71c:
  date: 2022-07-22_15-30-39
  done: true
  experiment_id: 3fdfaecb7adc4c5cb54c0aa76849d532
  experiment_tag: 6_height=-95.8831,steps=100,width=19.3982
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -9.536507956046009
  neg_mean_loss: 9.536507956046009
  node_ip: 127.0.0.1
  pid: 47036
  time_since_restore: 10.793061017990112
  time_this_iter_s: 0.10741710662841797
  time_total_s: 10.793061017990112
  timestamp: 1658500239
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: d42ac71c
  warmup_time: 0.0028409957885742188
  
Result for objective_d43ca61c:
  date: 2022-07-22_15-30-40
  done: true
  experiment_id: 8f92f519ea5443be9efd6f4a8937b8ee
  experiment_tag: 7_height=66.4885,steps=100,width=4.2468
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: 6.881177852950684
  neg_mean_loss: -6.881177852950684
  node_ip: 127.0.0.1
  pid: 47039
  time_since_restore: 10.760617017745972
  time_this_iter_s: 0.10911297798156738
  time_total_s: 10.760617017745972
  timestamp: 1658500240
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: d43ca61c
  warmup_time: 0.002924203872680664
  
Result for objective_d43fb190:
  date: 2022-07-22_15-30-40
  done: true
  experiment_id: 18283da742c74042ad3db1846fa7b460
  experiment_tag: 8_height=-63.6350,steps=100,width=3.6681
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -6.09550539698523
  neg_mean_loss: 6.09550539698523
  node_ip: 127.0.0.1
  pid: 47040
  time_since_restore: 10.799743175506592
  time_this_iter_s: 0.1067342758178711
  time_total_s: 10.799743175506592
  timestamp: 1658500240
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: d43fb190
  warmup_time: 0.0027680397033691406
  

Result for objective_dc25c796:
  date: 2022-07-22_15-30-42
  done: false
  experiment_id: c0f302c32b284f8e99dbdfa90657ee7d
  hostname: Kais-MacBook-Pro.local
  iterations: 0
  iterations_since_restore: 1
  mean_loss: 8.638900372842315
  neg_mean_loss: -8.638900372842315
  node_ip: 127.0.0.1
  pid: 47062
  time_since_restore: 0.10459494590759277
  time_this_iter_s: 0.10459494590759277
  time_total_s: 0.10459494590759277
  timestamp: 1658500242
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: dc25c796
  warmup_time: 0.002794981002807617
  
Result for objective_da1ff46c:
  date: 2022-07-22_15-30-44
  done: false
  experiment_id: 9163132451a14ace8ddf394aeaae9018
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -3.7164550549457847
  neg_mean_loss: 3.7164550549457847
  node_ip: 127.0.0.1
  pid: 47057
  time_since_restore: 5.180424928665161
  time_this_iter_s: 0.10843396186828613
  time_total_s: 5.180424928665161
  timestamp: 1658500244
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: da1ff46c
  warmup_time: 0.0030031204223632812
  
Result for objective_dc25c796:
  date: 2022-07-22_15-30-47
  done: false
  experiment_id: c0f302c32b284f8e99dbdfa90657ee7d
  hostname: Kais-MacBook-Pro.local
  iterations: 47
  iterations_since_restore: 48
  mean_loss: -1.0086834162426133
  neg_mean_loss: 1.0086834162426133
  node_ip: 127.0.0.1
  pid: 47062
  time_since_restore: 5.151978015899658
  time_this_iter_s: 0.10736894607543945
  time_total_s: 5.151978015899658
  timestamp: 1658500247
  timesteps_since_restore: 0
  training_iteration: 48
  trial_id: dc25c796
  warmup_time: 0.002794981002807617
  
Result for objective_da1ff46c:
  date: 2022-07-22_15-30-49
  done: false
  experiment_id: 9163132451a14ace8ddf394aeaae9018
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: -3.814808150093952
  neg_mean_loss: 3.814808150093952
  node_ip: 127.0.0.1
  pid: 47057
  time_since_restore: 10.23661208152771
  time_this_iter_s: 0.1076211929321289
  time_total_s: 10.23661208152771
  timestamp: 1658500249
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: da1ff46c
  warmup_time: 0.0030031204223632812
  
Result for objective_da1ff46c:
  date: 2022-07-22_15-30-49
  done: true
  experiment_id: 9163132451a14ace8ddf394aeaae9018
  experiment_tag: 9_height=-39.1516,steps=100,width=10.4951
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -3.819827867781687
  neg_mean_loss: 3.819827867781687
  node_ip: 127.0.0.1
  pid: 47057
  time_since_restore: 10.77621078491211
  time_this_iter_s: 0.10817480087280273
  time_total_s: 10.77621078491211
  timestamp: 1658500249
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: da1ff46c
  warmup_time: 0.0030031204223632812
  
Result for objective_dc25c796:
  date: 2022-07-22_15-30-52
  done: false
  experiment_id: c0f302c32b284f8e99dbdfa90657ee7d
  hostname: Kais-MacBook-Pro.local
  iterations: 94
  iterations_since_restore: 95
  mean_loss: -1.1817308993292515
  neg_mean_loss: 1.1817308993292515
  node_ip: 127.0.0.1
  pid: 47062
  time_since_restore: 10.179337978363037
  time_this_iter_s: 0.1043100357055664
  time_total_s: 10.179337978363037
  timestamp: 1658500252
  timesteps_since_restore: 0
  training_iteration: 95
  trial_id: dc25c796
  warmup_time: 0.002794981002807617
  
Result for objective_dc25c796:
  date: 2022-07-22_15-30-53
  done: true
  experiment_id: c0f302c32b284f8e99dbdfa90657ee7d
  experiment_tag: 10_height=-13.6110,steps=100,width=5.8246
  hostname: Kais-MacBook-Pro.local
  iterations: 99
  iterations_since_restore: 100
  mean_loss: -1.190635502081924
  neg_mean_loss: 1.190635502081924
  node_ip: 127.0.0.1
  pid: 47062
  time_since_restore: 10.721266031265259
  time_this_iter_s: 0.10741806030273438
  time_total_s: 10.721266031265259
  timestamp: 1658500253
  timesteps_since_restore: 0
  training_iteration: 100
  trial_id: dc25c796
  warmup_time: 0.002794981002807617
  

以下是为最小化定义目标函数的损失均值而找到的超参数。

print("Best hyperparameters found were: ", results.get_best_result().config)

Best hyperparameters found were:  {'steps': 100, 'width': 19.398197043239886, 'height': -95.88310114083951}