Skip to content

Problem with d4rl env #7

Open
Open
Problem with d4rl env#7

Description

@FanmingL
FanmingL
opened on May 24, 2023
  1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
  2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
  3. ray==1.2版本报错：
    Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
    以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。

OfflineRL 版本: 08f51b5
系统 Ubuntu 20.04.1 LTS x86_64
python==3.8.10
运行的命令：

python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

    , 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all 
     blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Problem with d4rl env · Issue #7 · polixir/OfflineRL · GitHub
    Skip to content
    Problem with d4rl env #7
    Open
    Open
    Problem with d4rl env#7
    Description
    @FanmingL
    FanmingL
    opened on May 24, 2023
    1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
    2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
    3. ray==1.2版本报错：
      Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
      
以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。
    OfflineRL 版本: 08f51b5
    
系统 Ubuntu 20.04.1 LTS x86_64
    
python==3.8.10
    
运行的命令：
    python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2
    Metadata
    Metadata
    Assignees
    No one assigned
      Labels
      No labels
      No labels
      Type
      No type
      Projects
      No projects
      Milestone
      No milestone
      Relationships
      None yet
      Development
      No branches or pull requests
      Issue actions
      
, 'i');
if (__m === '*' || __re.test(location.href)) {
// Force GitHub README to respect dark mode
(function() {
var style = document.createElement('style');
style.textContent = '
.markdown-body {
color-scheme: dark light;
}
.markdown-body pre { background: #161b22 !important; }
.markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }
.markdown-body table th, .markdown-body table td { border-color: #30363d !important; }
.markdown-body img { background: #0d1117; }
.markdown-body blockquote { border-left-color: #8b949e; }
.markdown-body hr { border-color: #30363d; }
';
document.head.appendChild(style);
})();
}
} catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Problem with d4rl env · Issue #7 · polixir/OfflineRL · GitHub
      Skip to content
      Problem with d4rl env #7
      Open
      Open
      Problem with d4rl env#7
      Description
      @FanmingL
      FanmingL
      opened on May 24, 2023
      1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
      2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
      3. ray==1.2版本报错：
        Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
        
以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。
      OfflineRL 版本: 08f51b5
      
系统 Ubuntu 20.04.1 LTS x86_64
      
python==3.8.10
      
运行的命令：
      python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2
      Metadata
      Metadata
      Assignees
      No one assigned
        Labels
        No labels
        No labels
        Type
        No type
        Projects
        No projects
        Milestone
        No milestone
        Relationships
        None yet
        Development
        No branches or pull requests
        Issue actions
        
, 'i');
if (__m === '*' || __re.test(location.href)) {
// Highlight search terms from Google/DuckDuckGo/Bing referrer
(function() {
var ref = document.referrer;
var terms = [];
if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {
var url = new URL(ref);
var q = url.searchParams.get('q') || url.searchParams.get('p');
if (q) {
terms = q.split(/\s+/).filter(function(t) { return t.length > 2; });
}
}
if (terms.length === 0) return;
var style = document.createElement('style');
style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';
document.head.appendChild(style);
function highlight(node) {
if (node.nodeType === 3) { // text node
var text = node.textContent;
var found = false;
terms.forEach(function(term) {
var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi');
if (regex.test(text)) {
found = true;
var frag = document.createDocumentFragment();
var parts = text.split(regex);
parts.forEach(function(part, i) {
if (i % 2 === 0) {
frag.appendChild(document.createTextNode(part));
} else {
var span = document.createElement('span');
span.className = 'userscript-highlight';
span.textContent = part;
frag.appendChild(span);
}
});
node.parentNode.replaceChild(frag, node);
}
});
} else if (node.nodeType === 1 && node.childNodes) { // element
var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];
if (!skipTags.includes(node.tagName)) {
Array.from(node.childNodes).forEach(highlight);
}
}
}
highlight(document.body);
// Re-highlight on dynamic content
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1 || node.nodeType === 3) highlight(node);
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Problem with d4rl env · Issue #7 · polixir/OfflineRL · GitHub
        Skip to content
        Problem with d4rl env #7
        Open
        Open
        Problem with d4rl env#7
        Description
        @FanmingL
        FanmingL
        opened on May 24, 2023
        1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
        2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
        3. ray==1.2版本报错：
          Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
          
以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。
        OfflineRL 版本: 08f51b5
        
系统 Ubuntu 20.04.1 LTS x86_64
        
python==3.8.10
        
运行的命令：
        python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2
        Metadata
        Metadata
        Assignees
        No one assigned
          Labels
          No labels
          No labels
          Type
          No type
          Projects
          No projects
          Milestone
          No milestone
          Relationships
          None yet
          Development
          No branches or pull requests
          Issue actions
          
, 'i');
if (__m === '*' || __re.test(location.href)) {
// Strip utm_, fbclid, gclid, etc. from all links on page
(function() {
var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',
'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',
'ref', 'ref_src', 'source', 'medium', 'campaign'];
function cleanUrl(url) {
try {
var u = new URL(url, window.location.origin);
var changed = false;
trackingParams.forEach(function(p) {
if (u.searchParams.has(p)) {
u.searchParams.delete(p);
changed = true;
}
});
return changed ? u.toString() : url;
} catch (e) {
return url;
}
}
function cleanLinks() {
document.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
cleanLinks();
var observer = new MutationObserver(function(mutations) {
mutations.forEach(function(m) {
m.addedNodes.forEach(function(node) {
if (node.nodeType === 1) {
if (node.tagName === 'A') cleanLinks();
node.querySelectorAll('a[href]').forEach(function(a) {
var clean = cleanUrl(a.href);
if (clean !== a.href) a.href = clean;
});
}
});
});
});
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); }
})();
(function(){
try {
var __m = "youtube.com";
var __re = new RegExp('^' + "youtube\\.com" + '
Problem with d4rl env · Issue #7 · polixir/OfflineRL · GitHub
          Skip to content
          Problem with d4rl env #7
          Open
          Open
          Problem with d4rl env#7
          Description
          @FanmingL
          FanmingL
          opened on May 24, 2023
          1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
          2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
          3. ray==1.2版本报错：
            Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
            
以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。
          OfflineRL 版本: 08f51b5
          
系统 Ubuntu 20.04.1 LTS x86_64
          
python==3.8.10
          
运行的命令：
          python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2
          Metadata
          Metadata
          Assignees
          No one assigned
            Labels
            No labels
            No labels
            Type
            No type
            Projects
            No projects
            Milestone
            No milestone
            Relationships
            None yet
            Development
            No branches or pull requests
            Issue actions
            
, 'i');
if (__m === '*' || __re.test(location.href)) {
// Auto-enable theater mode on YouTube
(function() {
function tryTheater() {
var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]');
if (btn && !btn.classList.contains('activated')) {
btn.click();
}
}
// Try immediately
tryTheater();
// Try after navigation (SPA)
var lastUrl = location.href;
setInterval(function() {
if (location.href !== lastUrl) {
lastUrl = location.href;
setTimeout(tryTheater, 500);
}
}, 1000);
// Also try on player load
var observer = new MutationObserver(tryTheater);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); }
})();
(function(){
try {
var __m = "*";
var __re = new RegExp('^' + ".*" + '
Problem with d4rl env · Issue #7 · polixir/OfflineRL · GitHub
            Skip to content
            Problem with d4rl env #7
            Open
            Open
            Problem with d4rl env#7
            Description
            @FanmingL
            FanmingL
            opened on May 24, 2023
            1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
            2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
            3. ray==1.2版本报错：
              Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
              
以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。
            OfflineRL 版本: 08f51b5
            
系统 Ubuntu 20.04.1 LTS x86_64
            
python==3.8.10
            
运行的命令：
            python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2
            Metadata
            Metadata
            Assignees
            No one assigned
              Labels
              No labels
              No labels
              Type
              No type
              Projects
              No projects
              Milestone
              No milestone
              Relationships
              None yet
              Development
              No branches or pull requests
              Issue actions
              
, 'i');
if (__m === '*' || __re.test(location.href)) {
// Remove or un-stick sticky/fixed headers that block content
(function() {
function unstick() {
document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) {
if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {
el.style.position = 'static';
el.style.top = 'auto';
el.style.zIndex = 'auto';
}
});
}
unstick();
var observer = new MutationObserver(unstick);
observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });
})();
}
} catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); }
})();
})();
Problem with d4rl env · Issue #7 · polixir/OfflineRL · GitHub
              Skip to content
              Problem with d4rl env #7
              Open
              Open
              Problem with d4rl env#7
              Description
              @FanmingL
              FanmingL
              opened on May 24, 2023
              1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
              2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
              3. ray==1.2版本报错：
                Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known
                
以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。
              OfflineRL 版本: 08f51b5
              
系统 Ubuntu 20.04.1 LTS x86_64
              
python==3.8.10
              
运行的命令：
              python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2
              Metadata
              Metadata
              Assignees
              No one assigned
                Labels
                No labels
                No labels
                Type
                No type
                Projects
                No projects
                Milestone
                No milestone
                Relationships
                None yet
                Development
                No branches or pull requests
                Issue actions