I try to pipeline Heroku Postgres to Kafka , kafkaconnect to snowflake.
I had all the attributes set in connect.distributed.properties file.
But getting Error for H10, R15, R10 from the below Heroku Logs.
Guide me to resolve this.
Heroku Logs are given below for references . I couldn't pasted complete logs for the reason of limitation in pasting here in this forum.
2021-02-04T00:03:42.454319+00:00 heroku[web.1]: State changed from starting to crashed
2021-02-04T00:03:42.465041+00:00 heroku[web.1]: State changed from crashed to starting
2021-02-04T00:03:47.023721+00:00 heroku[logplex]: Error L10 (output buffer overflow): drain 'd.7ecac605-b970-4a84-ac22-04552f489cd9' dropped 3 messages since 2021-02-04T00:02:47.157222+00:00.
2021-02-04T00:03:49.488380+00:00 heroku[logplex]: Error L10 (output buffer overflow): drain 'd.7ecac605-b970-4a84-ac22-04552f489cd9' dropped 2 messages since 2021-02-04T00:02:49.622107+00:00.
2021-02-04T00:03:57.689377+00:00 heroku[logplex]: Error L10 (output buffer overflow): drain 'd.7ecac605-b970-4a84-ac22-04552f489cd9' dropped 2 messages since 2021-02-04T00:02:57.822658+00:00.
2021-02-04T00:04:05.605070+00:00 heroku[run.2011]: source=run.2011 dyno=heroku.049be91d-2b0a-44c6-b1ee-6fd6a30819e1.d0a2e5b2-05ab-4e37-b81a-76b3a670c8ac sample#load_avg_1m=0.00 sample#load_avg_5m=0.00 sample#load_avg_15m=0.00
2021-02-04T00:04:05.605979+00:00 heroku[run.2011]: source=run.2011 dyno=heroku.049be91d-2b0a-44c6-b1ee-6fd6a30819e1.d0a2e5b2-05ab-4e37-b81a-76b3a670c8ac sample#memory_total=18.77MB sample#memory_rss=10.76MB sample#memory_cache=6.87MB sample#memory_swap=0.00MB sample#memory_pgpgin=2148pages sample#memory_pgpgout=189pages sample#memory_quota=2560.00MB
2021-02-04T00:04:05.855980+00:00 heroku[logplex]: Error L10 (output buffer overflow): drain 'd.7ecac605-b970-4a84-ac22-04552f489cd9' dropped 5 messages since 2021-02-04T00:03:06.092064+00:00.
2021-02-04T00:04:06.464579+00:00 app[web.1]: sfsc-kafka-c1-test
2021-02-04T00:04:06.464657+00:00 app[web.1]: ======== sfsc-kafka-c1-test =====
2021-02-04T00:04:06.464724+00:00 app[web.1]: Client Cert Key: CK-
2021-02-04T00:04:06.464775+00:00 app[web.1]: Client Cert: TP-
2021-02-04T00:04:06.464816+00:00 app[web.1]: Trusted Cert: KP-
2021-02-04T00:04:06.471250+00:00 app[web.1]: No Error while creating .pem files
2021-02-04T00:04:06.471252+00:00 app[web.1]: keystore - $ /etc/kafka/keystore.pem
2021-02-04T00:04:06.471292+00:00 app[web.1]: trusted - $ /etc/kafka/truststore.pem
2021-02-04T00:04:06.792240+00:00 app[web.1]: Certificate was added to keystore
2021-02-04T00:04:06.806985+00:00 app[web.1]: unable to write 'random state'
2021-02-04T00:04:06.988712+00:00 app[web.1]: Importing keystore /etc/kafka/keystore.pkcs12 to /etc/kafka/keystore.jks...
2021-02-04T00:04:07.229811+00:00 app[web.1]: Entry for alias 1 successfully imported.
2021-02-04T00:04:07.232028+00:00 app[web.1]: Import command completed: 1 entries successfully imported, 0 entries failed or cancelled
2021-02-04T00:04:07.233344+00:00 app[web.1]:
2021-02-04T00:04:07.233389+00:00 app[web.1]: Warning:
2021-02-04T00:04:07.233511+00:00 app[web.1]: The JKS keystore uses a proprietary format. It is recommended to migrate to PKCS12 which is an industry standard format using "keytool -importkeystore -srckeystore /etc/kafka/keystore.jks -destkeystore /etc/kafka/keystore.jks -deststoretype pkcs12".
2021-02-04T00:04:07.261163+00:00 app[web.1]: * Hostname was NOT found in DNS cache
2021-02-04T00:04:07.263708+00:00 app[web.1]: % Total % Received % Xferd Average Speed Time Time Time Current
2021-02-04T00:04:07.264877+00:00 app[web.1]: Dload Upload Total Spent Left Speed
2021-02-04T00:04:07.326777+00:00 app[web.1]:
2021-02-04T00:04:07.327743+00:00 app[web.1]:
2021-02-04T00:04:07.328101+00:00 app[web.1]: * successfully set certificate verify locations:
2021-02-04T00:04:07.328101+00:00 app[web.1]: * CAfile: none
2021-02-04T00:04:07.328104+00:00 app[web.1]: CApath: /etc/ssl/certs
2021-02-04T00:04:07.328273+00:00 app[web.1]: * SSLv3, TLS handshake, Client hello (1):
2021-02-04T00:04:07.328274+00:00 app[web.1]: } [data not shown]
2021-02-04T00:04:07.331949+00:00 app[web.1]: * SSLv3, TLS handshake, Server hello (2):
2021-02-04T00:04:07.331950+00:00 app[web.1]: { [data not shown]
2021-02-04T00:04:07.331988+00:00 app[web.1]: * SSLv3, TLS handshake, CERT (11):
2021-02-04T00:04:07.331989+00:00 app[web.1]: { [data not shown]
2021-02-04T00:04:07.332909+00:00 app[web.1]: * SSLv3, TLS handshake, Server key exchange (12):
2021-02-04T00:04:07.332910+00:00 app[web.1]: { [data not shown]
2021-02-04T00:04:07.333130+00:00 app[web.1]: * SSLv3, TLS handshake, Server finished (14):
2021-02-04T00:04:07.333131+00:00 app[web.1]: { [data not shown]
2021-02-04T00:04:07.333789+00:00 app[web.1]: * SSLv3, TLS handshake, Client key exchange (16):
2021-02-04T00:04:07.333790+00:00 app[web.1]: } [data not shown]
2021-02-04T00:04:07.333818+00:00 app[web.1]: * SSLv3, TLS change cipher, Client hello (1):
2021-02-04T00:04:07.333819+00:00 app[web.1]: } [data not shown]
2021-02-04T00:04:07.333941+00:00 app[web.1]: * SSLv3, TLS handshake, Finished (20):
2021-02-04T00:04:07.333941+00:00 app[web.1]: } [data not shown]
2021-02-04T00:04:07.334954+00:00 app[web.1]: * SSLv3, TLS change cipher, Client hello (1):
2021-02-04T00:04:07.334988+00:00 app[web.1]: { [data not shown]
2021-02-04T00:04:07.335092+00:00 app[web.1]: * SSLv3, TLS handshake, Finished (20):
2021-02-04T00:04:07.335124+00:00 app[web.1]: { [data not shown]
2021-02-04T00:04:07.335150+00:00 app[web.1]: * SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384
2021-02-04T00:04:07.335151+00:00 app[web.1]: * Server certificate:
2021-02-04T00:04:07.335181+00:00 app[web.1]: * subject: CN=sfsc-kafka-c1-test.herokuapp.com
2021-02-04T00:04:07.335221+00:00 app[web.1]: * start date: 2021-01-04 16:52:40 GMT
2021-02-04T00:04:07.335221+00:00 app[web.1]: * expire date: 2021-04-04 16:52:40 GMT
2021-02-04T00:04:07.335222+00:00 app[web.1]: * subjectAltName: sfsc-kafka-c1-test.herokuapp.com matched
2021-02-04T00:04:07.335245+00:00 app[web.1]: * issuer: C=US; O=Let's Encrypt; CN=R3
2021-02-04T00:04:07.335245+00:00 app[web.1]: * SSL certificate verify ok.
2021-02-04T00:04:07.335424+00:00 app[web.1]: > POST /connectors HTTP/1.1
2021-02-04T00:04:07.335424+00:00 app[web.1]: > User-Agent: curl/7.38.0
2021-02-04T00:04:07.335425+00:00 app[web.1]: > Host: sfsc-kafka-c1-test.herokuapp.com
2021-02-04T00:04:07.335425+00:00 app[web.1]: > Accept: */*
2021-02-04T00:04:07.335425+00:00 app[web.1]: > Content-Type: application/json
2021-02-04T00:04:07.335426+00:00 app[web.1]: > Content-Length: 41
2021-02-04T00:04:07.335426+00:00 app[web.1]: >
2021-02-04T00:04:07.335468+00:00 app[web.1]: } [data not shown]
2021-02-04T00:04:07.335469+00:00 app[web.1]: * upload completely sent off: 41 out of 41 bytes
2021-02-04T00:04:07.248703+00:00 app[web.1]: Variables: kafka-dimensional-99909:-KAFKA kafka-dimensional-99909:-KAFKA_PREFIX kafka-dimensional-99909:-KAFKA_PREFIX kafka-dimensional-99909:-KAFKA_URL postgresql-graceful-54180:-DATABASE
2021-02-04T00:04:07.248748+00:00 app[web.1]: Secuirty protocal: H-/app TP-ReM{Fk[3s~<3<2T7 KP-N!C@NE8br7't9MG%
2021-02-04T00:04:07.248802+00:00 app[web.1]: ======== After postgres_addon_name =====
2021-02-04T00:04:07.250942+00:00 app[web.1]: ======== After CONNECT_STATUS_STORAGE_TOPIC =====
2021-02-04T00:04:07.251010+00:00 app[web.1]: ======== Before PORT =====
2021-02-04T00:04:07.251067+00:00 app[web.1]: ======== After PORT =====
2021-02-04T00:04:07.251180+00:00 app[web.1]: ======== After CONNECT_PLUGIN_PATH =====
2021-02-04T00:04:07.251231+00:00 app[web.1]: ============Starting Process=========
2021-02-04T00:04:07.251520+00:00 app[web.1]: Server URL https://sfsc-kafka-c1-test.herokuapp.com
2021-02-04T00:04:07.251582+00:00 app[web.1]: Heroku Port - 9092
2021-02-04T00:04:07.256739+00:00 app[web.1]: ===> User
2021-02-04T00:04:07.258718+00:00 app[web.1]: uid=3061(dyno) gid=3061(dyno) groups=3061(dyno)
2021-02-04T00:04:07.258990+00:00 app[web.1]: ===> Configuring ...
2021-02-04T00:04:11.097695+00:00 app[web.1]: ===> Running preflight checks ...
2021-02-04T00:04:11.100407+00:00 app[web.1]: ===> Check if Kafka is healthy ...
2021-02-04T00:04:11.642347+00:00 app[web.1]:
2021-02-04T00:04:11.642351+00:00 app[web.1]: client.dns.lookup = default
2021-02-04T00:04:11.642352+00:00 app[web.1]: client.id =
2021-02-04T00:04:11.642352+00:00 app[web.1]: connections.max.idle.ms = 300000
2021-02-04T00:04:11.642353+00:00 app[web.1]: default.api.timeout.ms = 60000
2021-02-04T00:04:11.642353+00:00 app[web.1]: metadata.max.age.ms = 300000
2021-02-04T00:04:11.642353+00:00 app[web.1]: metric.reporters = []
2021-02-04T00:04:11.642354+00:00 app[web.1]: metrics.num.samples = 2
2021-02-04T00:04:11.642354+00:00 app[web.1]: metrics.recording.level = INFO
2021-02-04T00:04:11.642354+00:00 app[web.1]: metrics.sample.window.ms = 30000
2021-02-04T00:04:11.642355+00:00 app[web.1]: receive.buffer.bytes = 65536
2021-02-04T00:04:11.642355+00:00 app[web.1]: reconnect.backoff.max.ms = 1000
2021-02-04T00:04:11.642355+00:00 app[web.1]: reconnect.backoff.ms = 50
2021-02-04T00:04:11.642356+00:00 app[web.1]: request.timeout.ms = 30000
2021-02-04T00:04:11.642356+00:00 app[web.1]: retries = 2147483647
2021-02-04T00:04:11.642356+00:00 app[web.1]: retry.backoff.ms = 100
2021-02-04T00:04:11.642356+00:00 app[web.1]: sasl.client.callback.handler.class = null
2021-02-04T00:04:11.642357+00:00 app[web.1]: sasl.jaas.config = null
2021-02-04T00:04:11.642357+00:00 app[web.1]: sasl.kerberos.kinit.cmd = /usr/bin/kinit
2021-02-04T00:04:11.642357+00:00 app[web.1]: sasl.kerberos.min.time.before.relogin = 60000
2021-02-04T00:04:11.642358+00:00 app[web.1]: sasl.kerberos.service.name = null
2021-02-04T00:04:11.642358+00:00 app[web.1]: sasl.kerberos.ticket.renew.jitter = 0.05
2021-02-04T00:04:11.642358+00:00 app[web.1]: sasl.kerberos.ticket.renew.window.factor = 0.8
2021-02-04T00:04:11.642358+00:00 app[web.1]: sasl.login.callback.handler.class = null
2021-02-04T00:04:11.642358+00:00 app[web.1]: sasl.login.class = null
2021-02-04T00:04:11.642359+00:00 app[web.1]: sasl.login.refresh.buffer.seconds = 300
2021-02-04T00:04:11.642359+00:00 app[web.1]: sasl.login.refresh.min.period.seconds = 60
2021-02-04T00:04:11.642359+00:00 app[web.1]: sasl.login.refresh.window.factor = 0.8
2021-02-04T00:04:11.642360+00:00 app[web.1]: sasl.login.refresh.window.jitter = 0.05
2021-02-04T00:04:11.642360+00:00 app[web.1]: sasl.mechanism = GSSAPI
2021-02-04T00:04:11.642360+00:00 app[web.1]: security.protocol = SSL
2021-02-04T00:04:11.642360+00:00 app[web.1]: security.providers = null
2021-02-04T00:04:11.642360+00:00 app[web.1]: send.buffer.bytes = 131072
2021-02-04T00:04:11.642361+00:00 app[web.1]: ssl.cipher.suites = null
2021-02-04T00:04:11.642362+00:00 app[web.1]: ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
2021-02-04T00:04:11.642362+00:00 app[web.1]: ssl.endpoint.identification.algorithm =
2021-02-04T00:04:11.642362+00:00 app[web.1]: ssl.key.password = [hidden]
2021-02-04T00:04:11.642363+00:00 app[web.1]: ssl.keymanager.algorithm = SunX509
2021-02-04T00:04:11.642363+00:00 app[web.1]: ssl.keystore.location = /etc/kafka/keystore.jks
2021-02-04T00:04:11.642363+00:00 app[web.1]: ssl.keystore.password = [hidden]
2021-02-04T00:04:11.642363+00:00 app[web.1]: ssl.keystore.type = JKS
2021-02-04T00:04:11.642364+00:00 app[web.1]: ssl.protocol = TLS
2021-02-04T00:04:11.642364+00:00 app[web.1]: ssl.provider = null
2021-02-04T00:04:11.642364+00:00 app[web.1]: ssl.secure.random.implementation = null
2021-02-04T00:04:11
与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…
