代码之家  ›  专栏  ›  技术社区  ›  lippoliv

Docker容器中的Elasticsearch在简单重启后“无法写入数据目录”

permission-denied docker-compose elasticsearch
  •  4
  • lippoliv  · 技术社区  · 7 年前

    这一切都很完美。今天,我在logstash中调用了一些新模式,出于某种原因,我通过 docker-compose down && docker-compose up -d .

    现在elasticsearch不再启动。 

    root@xyz:/srv/elk# docker-compose logs elasticsearch
Attaching to elk_elasticsearch_1
elasticsearch_1  | [2017-07-01T07:34:36,859][INFO ][o.e.n.Node               ] [lw-e01] initializing ...
elasticsearch_1  | [2017-07-01T07:34:36,999][INFO ][o.e.e.NodeEnvironment    ] [lw-e01] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/HDD-ELK)]], net usable_space [19.1gb], net total_space [49gb], spins? [possibly], types [ext4]
elasticsearch_1  | [2017-07-01T07:34:36,999][INFO ][o.e.e.NodeEnvironment    ] [lw-e01] heap size [3.9gb], compressed ordinary object pointers [true]
elasticsearch_1  | [2017-07-01T07:34:37,635][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [lw-e01] uncaught exception in thread [main]
elasticsearch_1  | org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to created node environment
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:127) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:114) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:67) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:122) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.cli.Command.main(Command.java:88) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  | Caused by: java.lang.IllegalStateException: Failed to created node environment
elasticsearch_1  |      at org.elasticsearch.node.Node.<init>(Node.java:265) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.node.Node.<init>(Node.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap$6.<init>(Bootstrap.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:360) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      ... 6 more
elasticsearch_1  | Caused by: java.io.IOException: failed to write in data directory [/usr/share/elasticsearch/data/nodes/0/indices/a94kXbSER2CE97qdPhgVLA/_state] write permission is required
elasticsearch_1  |      at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1075) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1047) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:277) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.node.Node.<init>(Node.java:262) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.node.Node.<init>(Node.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap$6.<init>(Bootstrap.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:360) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      ... 6 more
elasticsearch_1  | Caused by: java.nio.file.FileAlreadyExistsException: /usr/share/elasticsearch/data/nodes/0/indices/a94kXbSER2CE97qdPhgVLA/_state/.es_temp_file
elasticsearch_1  |      at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88) ~[?:?]
elasticsearch_1  |      at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
elasticsearch_1  |      at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
elasticsearch_1  |      at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:?]
elasticsearch_1  |      at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_131]
elasticsearch_1  |      at java.nio.file.Files.createFile(Files.java:632) ~[?:1.8.0_131]
elasticsearch_1  |      at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1072) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1047) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:277) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.node.Node.<init>(Node.java:262) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.node.Node.<init>(Node.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap$6.<init>(Bootstrap.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:360) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) ~[elasticsearch-5.4.0.jar:5.4.0]
elasticsearch_1  |      ... 6 more

    chown -R 1000.1000 elasticsearch/ 它崩溃(并设置其他所有权)。

    docker-compose.yml 我描述了这三种服务。 

    version: '3'

services:
  elasticsearch:
    image: my/elasticsearch/image:5.4.0
    volumes:
      - ./elasticsearch/data:/usr/share/elasticsearch/data
      - ./elasticsearch/config:/usr/share/elasticsearch/config
      - /etc/localtime:/etc/localtime:ro
    environment:
      ES_JAVA_OPTS: "-Xmx4g -Xms1g"
    ulimits:
      memlock:
        soft: -1
        hard: -1
    networks:
      - nginx_net

  logstash:
    image: my/logstash/image:5.4.0
    command: ["logstash", "-f", "/etc/logstash.conf"]
    volumes:
      - ./logstash.conf:/etc/logstash.conf:ro
      - ./logstash.yml:/etc/logstash/logstash.yml:ro
      - ./GeoDb/GeoLite2-City.mmdb:/GeoLite2-City.mmdb:ro
      - ./patterns:/etc/logstash/patterns:ro
      - /etc/localtime:/etc/localtime:ro
    ports:
      - "5044:5044"
    environment:
      LS_JAVA_OPTS: "-Xmx1g -Xms512m"
    depends_on:
      - elasticsearch
    networks:
      - nginx_net

  kibana:
    image: my/kibana/image:5.4.0
    volumes:
      - ./kibana/config/:/usr/share/kibana/config
      - ./kibana/config/kibana.yml:/etc/kibana/kibana.yml
      - /etc/localtime:/etc/localtime:ro
    depends_on:
      - elasticsearch
    networks:
      - nginx_net

networks:
  nginx_net:
    external: true


    FROM elasticsearch:5.4.0

RUN bin/elasticsearch-plugin install x-pack --batch

    我所做的不同之处在于,我没有使用命名卷。这是因为我喜欢有一个包含整个项目的文件夹,这对我的LVM管理也更好。 

    root@xyz:/srv/elk# ls -l
insgesamt 43488
-rw-r--r-- 1 root root     1514 Jul  1 09:34 docker-compose.yml
drwxr-xr-x 4 1000 1000     4096 Mai 18 17:43 elasticsearch
drwxr-xr-x 3 root root     4096 Mai 21 12:49 GeoDb
-rw-r--r-- 1 root root 25398754 Mai 21 12:49 GeoLite2-City.tar.gz
-rw-r--r-- 1 root root 19074950 Mai 21 12:03 GeoLiteCity.dat
drwxr-xr-x 3 root root     4096 Mai 14 16:20 kibana
-rw-r--r-- 1 root root     5523 Jul  1 09:02 logstash.conf
-rw-r--r-- 1 root root     4708 Jun  3 11:25 logstash.yml
drwx------ 2 root root    16384 Mai 17 23:40 lost+found
drwxr-xr-x 2 root root     4096 Jun  7 22:08 patterns
-rwxr-xr-x 1 root root      168 Mai 21 12:49 update-geoip.sh
root@xyz:/srv/elk# du -hs elasticsearch/
28G     elasticsearch/

    我读过一些插件,比如 local-persist 要使用命名卷,还要指定将文件保存到的目录。但我也读到,docker建议不要在生产中使用插件。

    2 回复  |  直到 7 年前
        1
  •  3
  •   lippoliv    7 年前

    OK简单:运行(在我的情况下) rm elasticsearch/data/nodes/0/indices/a94kXbSER2CE97qdPhgVLA/_s‌​tate/.es_temp_file 在docker compose项目的主文件夹中帮助我再次启动EL。。。

    java.nio.file.FileAlreadyExistsException

        2
  •  0
  •   codenamev    7 年前

    上面的答案对我不起作用。这最终是Docker的记忆问题。提高Docker的内存分配解决了这个问题。

    推荐文章
    ViaTech  ·  Docker Compose,PHP和Nginx不参与生产
    2 年前
    mogale  ·  docker合成服务名称
    2 年前
    Shwetha K  ·  Docker错误:MySQLdb_例外。操作错误:(2002,“无法通过套接字'/var/run/mysqld/mysqld.sock'(2)连接到本地MySQL服务器”)
    2 年前
    Saad Elmatbai  ·  将docker compose连接到本地计算机
    2 年前
    membersound  ·  如何将多个docker compose文件与扩展名字段和yml锚合并?
    2 年前
    anton-stadler  ·  普罗米修斯:从水平缩放的微服务中刮取日志
    2 年前
    Eric Hansen  ·  可以让docker compose无限期运行的最小图像是什么?
    2 年前
    Richard Rublev  ·  为什么我不能启动代理服务?绑定0.0.0.0:8000失败:端口已分配
    2 年前
    user51  ·  来自守护进程的Docker compose错误响应:nginx的清单:1.15-alphine未找到:清单未知:清单未知
    2 年前
    Hades  ·  如何让VS2019+运行docker compose?
    2 年前
    关于   移动版
    代码之家 - 一站式码农服务社区
    沪ICP备11025650号