76_SMAPortal - Integration SMA Sunny Portal - Ideen & Modulweiterentwicklung

[DS_Starter]

Hi Jens,

ja unbedingt, kommt sowieso bald im Rollout.
Aber mich wundert das echt dass du diesbezüglich soviel Probs hast. Wie stehen denn die Readings dailyCallCounter / dailyIssueCookieCounter ?

LG,
Heiko

[Bitschubser]

Hallo Heiko,

Hab den User bei SMA gelöscht und neu angelegt, danach dessen Passwort neu gesetzt und schon läuft es wieder.

in den Readings steht:
dailyCallCounter 20:160 2020-06-20 13:06:52
dailyIssueCookieCounter 20:5 2020-06-20 13:06:52

gestern ist es den ganzen Tag nicht gelaufen.

[DS_Starter]

Hmmm, ist zwar schön aber nicht gut. 
Die Readings zeigen normale Werte bis auf den geringen Wert von dailyIssueCookieCounter weil kein Login und demzufolge auch kein Cookie ausgestellt wurde.
Merkwürdig, kann mir da auch grade kein Reim drauf machen, müssen wir beobachten und die Bausteinchen zusammen setzen.
Wie gesagt, läuft bei mir astrein.

[DS_Starter]

@kroonen,  @all,

in my contrib is the version 3.1.0
I have eliminated the possible sequence problem with the data providers.

Furthermore language support is built in. Depending on the attribute global language (EN/DE) the messages from the portal (error message, info message, logbook entries ...) are displayed in english (default) or german in the module.

I had already prepared this in the background and now it comes with the delivery.

@kroonen, please test it.

LG,
Heiko 

[DS_Starter]

@Jens,
eine Idee hätte ich noch. Sollte das noch einmal vorkommen, setz dir doch bitte das Attr showPassInLog = 1 und schau im Log nach ob das richtige Passwort vom Modul ausgelesen wurde.

Das siehst du mit verbose 4:

Code Auswählen Erweitern


2020.06.20 13:35:28.608 4: Sonnenstrom1 - Credentials read from RAM: run@xxxxxx xxxxxx


Ich glaube zwar nicht dass dort ein Fehler vorliegt, aber um sicher zu gehen ...

[Bitschubser]

Ich werde das bei Gelegenheit machen,
oder gleich auf V3 umsteigen.

Zumindest wird das korrekte Passwort über get <device> storedCredentials angezeigt.

[DS_Starter]

Stell am Besten gleich um. Das Logbuch ist da nun auch drin sowie Sprachensupport und mit dieser Version gehts auch weiter.
Ist auch nicht so viel zu machen, nur die Attribute entsprechend setzen und evtl. Abhängigkeiten von den L-Leveln in notify etc. richten.

[kroonen]

Ok i have logging already, but I wait for the next version. (still no graphs and still plant id missin) did a restart of fhem

Code Auswählen Erweitern


2020.06.20 19:15:58 3: portaal - ################################################################
2020.06.20 19:15:58 3: portaal - ###      start new set/get data from SMA Sunny Portal        ###
2020.06.20 19:15:58 3: portaal - ################################################################
2020.06.20 19:15:58 4: portaal - calculated cycles summary time: 5.6
2020.06.20 19:15:58 4: portaal - calculated maximum cycles:      52
2020.06.20 19:15:58 4: portaal - calculated timeout:             286
2020.06.20 19:15:58 3: portaal - Running data cycle: 1 of 52
2020.06.20 19:15:58 5: portaal - Start operation with CookieLocation: ./log/portaal_cookie.txt and UserAgent: Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; Trident/6.0)
2020.06.20 19:15:58 5: portaal - data get: all, data set: none
2020.06.20 19:16:04 4: portaal - User not logged in. Try login with credentials ...
2020.06.20 19:16:04 4: portaal - Credentials read from RAM: richard@k*****.eu ********
2020.06.20 19:16:04 3: portaal - Login into SMA-Portal successfully done with user: richard@******.eu
2020.06.20 19:16:04 4: portaal - Getting weatherData
2020.06.20 19:16:04 4: portaal - ##### extracting weather data ####
2020.06.20 19:16:04 4: portaal - Weatherdata content "today": $VAR1 = {
          'TemperatureSymbol' => "\x{b0}C",
          'WeatherDescription' => 'Cloudy',
          'WeatherIcon' => '/Images/Dashboard/Weather/02.png',
          'Temperature' => '18.2608242034912'
        };

2020.06.20 19:16:04 4: portaal - Weatherdata content "tomorrow": $VAR1 = {
          'TemperatureSymbol' => "\x{b0}C",
          'WeatherIcon' => '/Images/Dashboard/Weather/00.png',
          'Temperature' => '19.5209941864014',
          'WeatherDescription' => 'Cloudless'
        };

2020.06.20 19:16:04 2: portaal - The consumer data cannot be retrieved because of the plant ID isn't set.
2020.06.20 19:16:04 3: portaal - Cookie file deleted: ./log/portaal_cookie.txt
2020.06.20 19:16:04 4: portaal - Refresh - caller: SPG3.portaal, callerroom: "n.a.", detail: "n.a.", pload: 0, forcePageRefresh: 0, event_Spgdev: 1

Internals:
   CREDENTIALS Set
   FUUID      5eed2119-f33f-d772-e13b-7fc88af860916c3b
   FVERSION   76_SMAPortal.pm:v3.0.0-s22149/2020-06-09
   MODE       Automatic - next polltime: 19:20:58
   NAME       portaal
   NR         93
   STATE      The consumer data cannot be retrieved because of the plant ID isn't set.
   TYPE       SMAPortal
   HELPER:
     ACTCYCLE   1
     CYCLEBTIME 1592673358
     GETTER     all
     PACKAGE    FHEM::SMAPortal
     RETRIES    1
     SETTER     none
     SPGDETAIL
     SPGDEV     SPG3.portaal
     SPGROOM    SMAPortal
     VERSION    3.0.0
     oldlogintime 1592673364
   READINGS:
     2020-06-20 19:15:58   dailyCallCounter 20:114
     2020-06-20 19:16:04   dailyIssueCookieCounter 20:114
     2020-06-20 19:16:04   loginState      failed
     2020-06-20 19:16:04   state           The consumer data cannot be retrieved because of the plant ID isn't set.
Attributes:
   providerLevel consumerCurrentdata,consumerDayData,consumerMonthData,consumerYearData,forecastData,liveData,weatherData
   room       SMAPortal
   verbose    5
   verbose5Data consumerMasterdata,plantData

[DS_Starter]

but I wait for the next version

You don't have to wait, the version 3.1.0 is online in my contrib. 
Please download it and restart.

set verbose5Data to plantMasterData and give it a try.

Your log should be like this:

Code Auswählen Erweitern


2020.06.20 19:32:59.030 3: Sonnenstrom1 - ################################################################
2020.06.20 19:32:59.031 3: Sonnenstrom1 - ###      start new set/get data from SMA Sunny Portal        ###
2020.06.20 19:32:59.031 3: Sonnenstrom1 - ################################################################
2020.06.20 19:32:59.032 4: Sonnenstrom1 - calculated cycles summary time: 7
2020.06.20 19:32:59.033 4: Sonnenstrom1 - calculated maximum cycles:      19
2020.06.20 19:32:59.033 4: Sonnenstrom1 - calculated timeout:             290
2020.06.20 19:32:59.034 3: Sonnenstrom1 - Running data cycle: 1 of 19
2020.06.20 19:32:59.062 5: Sonnenstrom1 - Start operation with CookieLocation: ./log/Sonnenstrom1_cookie.txt and UserAgent: Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; Trident/6.0)
2020.06.20 19:32:59.063 5: Sonnenstrom1 - data get: all, data set: none
2020.06.20 19:32:59.229 4: Sonnenstrom1 - User not logged in. Try login with credentials ...
2020.06.20 19:32:59.231 4: Sonnenstrom1 - Credentials read from RAM: run@c******* ********
2020.06.20 19:32:59.521 3: Sonnenstrom1 - Login into SMA-Portal successfully done with user: run@c**********
2020.06.20 19:32:59.545 4: Sonnenstrom1 - Getting plantMasterData
GET https://www.sunnyportal.com/HoMan/Forecast/LoadRecommendationData
Connection: keep-alive
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: de,en-US;q=0.7,en;q=0.3
Host: www.sunnyportal.com
Referer: https://www.sunnyportal.com/FixedPages/HoManLive.aspx
User-Agent: Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; Trident/6.0)
Cookie: collapseNavi_state=shown; BIGipServerPool_P_SunnyPortal=3104090304.20480.0000; ASP.NET_SessionId=dr2avznf0nney4igg0ynw2ke; SunnyPortalPageCounter=0; .SunnyPortalFormsLogin=6EABDF7697AEE0D3BECCA4FD08DCF51118A09FA884675E976EF6C30E1D3668124B852AC3370F523DE190BB72FC073DAFB9B3AC4B5E0D8A7E0735AD7CBEB062612B38BE8E21ED5A376710506A2E5105CAFCC2BF24D128CD104FA620D147DC86CECD950E80B395CD3DF872CB7D2CF36233460098962A70F4BE3A3D2CAC71BEC915F714FECFCCED1C6AE19084A0E3C45EF106B0B2BD0195FCE773A0BD746C63520DD9C07D24D35E63CCBB0F8DC8BD82520576564E974730F900E749FEB8B13D42E3FB2E70739553D6FFFDAE4DAA58A6D99D0D33B2852E87E1A1D7D8E5B593631BB23337EF0C35B7D496235A28B1837CCBFC514F3FEB05551304D4674FE3D72EBB5122D2BFA3C08D8C7EE266F17FABC22271A4CAD66D1CF4EDB44DA8BD150280CDC90D87F3727EDDC253EBC53C0C5DD7EC8E7E1D18AEB50BBF21882053A8566A247A9F60F0110A329A2C6FE2E41A6A0A0CA549ECAE5F4CF7F4FE12FF11B04617D5CD3F86EF5A2BA0B63B45F5C7A5AD7E028D0290D00B058B6F38478B93B812B9048C67C614CD616E7AA5E7003E5A69B7323C396EA611C4EC7AAC9202B8B64B6AE9D6C00215274E991F0F24599FC366C1D5F97E44556BD253EEB593CE7616A85A48B9544AF6B3B171B4EEAD9239B8A9E360D55E569B3C8D7F2783598E5B4524B4826F745E217E7055065AB683209013B246045FF46A39962B3C0645535C32CB085A3E6C54B8CE1635E4A875EC88E437BBF65227C40185A0BE42CD0D16A7B3B3D580DCC72671661A8E0BDF15B70340A9D7D7DA599AAD0F67A6985ADC024A88C8D169B34D9B6F13
Cookie2: $Version="1"
DNT: 1
X-Requested-With: XMLHttpRequest

(no content)
HTTP/1.1 200 OK
Cache-Control: no-cache, no-store, must-revalidate
Date: Sat, 20 Jun 2020 17:33:00 GMT
Pragma: no-cache
Server: Microsoft-IIS/10.0
Content-Length: 30492
Content-Type: application/json; charset=utf-8
Expires: -1
Client-Date: Sat, 20 Jun 2020 17:33:00 GMT
Client-Peer: 171.25.178.37:443
Client-Response-Num: 1
Client-SSL-Cert-Issuer: /C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Domain Validation Secure Server CA
Client-SSL-Cert-Subject: /OU=Domain Control Validated/OU=COMODO SSL Wildcard/CN=*.sunnyportal.com
Client-SSL-Cipher: ECDHE-RSA-AES256-GCM-SHA384
Client-SSL-Socket-Class: IO::Socket::SSL
Set-Cookie: plantOid=9bfdbda3-9584-42e8-89fe-24b6f3dfbbf8; path=/; secure; HttpOnly
X-AspNet-Version: 4.0.30319
X-AspNetMvc-Version: 5.2

{"__type":"\\u003c\\u003ef__AnonymousType22`5","ForecastSeries":[{"__type":"ForecastChartDataPoint","TimeStamp":{"__type":"DateTime","DateTime":"2020-06-20T00:00:00","Kind":"Unspecified"},"WeatherId":130,"PvMeanPower":{"__type":"Power","Amount":"0","StandardUnit":{"__type":"Unit`1","Symbol":"W"}},"PvEnergy":{"__type":"Energy","Amount":"0","StandardUnit":{"__type":"Unit`1","Symbol":"J"}},"ConsumptionForecast":{"__type":"Energy","Amount":"1397879.9890136716","StandardUnit":{"__type":"Unit`1","Symbol":"J"}},"Gri...
(+ 29980 more bytes not shown)
2020.06.20 19:33:00.082 5: Sonnenstrom1 - Return Code: 200
2020.06.20 19:33:00.089 5: Sonnenstrom1 - plantMasterData received:
{
  'PlantPeakPower' => {
                        'Amount' => '5130',
                        '__type' => 'Power',
                        'StandardUnit' => {
                                            'Symbol' => 'W',
                                            '__type' => 'Unit`1'


[kroonen]

Hi

Looks like no error, only no json no portal graphics
Awaiting minor level forecast data ...

Code Auswählen Erweitern


020.06.20 20:48:02 3: portaal - ################################################################
2020.06.20 20:48:02 3: portaal - ###      start new set/get data from SMA Sunny Portal        ###
2020.06.20 20:48:02 3: portaal - ################################################################
2020.06.20 20:48:02 4: portaal - calculated cycles summary time: 5.6
2020.06.20 20:48:02 4: portaal - calculated maximum cycles:      52
2020.06.20 20:48:02 4: portaal - calculated timeout:             286
2020.06.20 20:48:02 3: portaal - Running data cycle: 1 of 52
2020.06.20 20:48:02 5: portaal - Start operation with CookieLocation: ./log/portaal_cookie.txt and UserAge
nt: Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; Trident/6.0)
2020.06.20 20:48:02 5: portaal - data get: all, data set: none
2020.06.20 20:48:08 4: portaal - User not logged in. Try login with credentials ...
2020.06.20 20:48:08 4: portaal - Credentials read from RAM: richard@******.eu ********
2020.06.20 20:48:08 3: portaal - Login into SMA-Portal successfully done with user: richard@*****.eu
2020.06.20 20:48:08 4: portaal - Getting plantMasterData
2020.06.20 20:48:08 5: portaal - No JSON Data received:
HTTP/1.1 200 OK
Cache-Control: no-cache, no-store, must-revalidate
Date: Sat, 20 Jun 2020 18:48:08 GMT
Pragma: no-cache
Server: Microsoft-IIS/10.0
Content-Length: 0
Expires: -1
Client-Date: Sat, 20 Jun 2020 18:48:08 GMT
Client-Peer: 171.25.178.37:443
Client-Response-Num: 1
Client-SSL-Cert-Issuer: /C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Domain Validation Secure Server CA
Client-SSL-Cert-Subject: /OU=Domain Control Validated/OU=COMODO SSL Wildcard/CN=*.sunnyportal.com
Client-SSL-Cipher: ECDHE-RSA-AES256-GCM-SHA384
Client-SSL-Socket-Class: IO::Socket::SSL
Set-Cookie: plantOid=3c013f0e-b46e-4449-882c-a0b2681b6f1e; path=/; secure; HttpOnly
X-AspNet-Version: 4.0.30319
X-AspNetMvc-Version: 5.2


2020.06.20 20:48:08 3: portaal - Cookie file deleted: ./log/portaal_cookie.txt
2020.06.20 20:48:08 4: portaal - Refresh - caller: SPG3.portaal, callerroom: SMAPortal, detail: "n.a.", pload: 0, forcePageRefresh: 0, event_Spgdev: 1

2020.06.20 20:53:14 3: portaal - ################################################################
2020.06.20 20:53:14 3: portaal - ###      start new set/get data from SMA Sunny Portal        ###
2020.06.20 20:53:14 3: portaal - ################################################################
2020.06.20 20:53:14 4: portaal - calculated cycles summary time: 5.6
2020.06.20 20:53:14 4: portaal - calculated maximum cycles:      52
2020.06.20 20:53:14 4: portaal - calculated timeout:             286
2020.06.20 20:53:14 3: portaal - Running data cycle: 1 of 52
2020.06.20 20:53:14 5: portaal - Start operation with CookieLocation: ./log/portaal_cookie.txt and UserAgent: Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; Trident/6.0)
2020.06.20 20:53:14 5: portaal - data get: all, data set: none
2020.06.20 20:53:20 4: portaal - User not logged in. Try login with credentials ...
2020.06.20 20:53:20 4: portaal - Credentials read from RAM: richard@*****.eu ********
2020.06.20 20:53:20 3: portaal - Login into SMA-Portal successfully done with user: richard@****.eu
2020.06.20 20:53:20 4: portaal - Getting plantMasterData
2020.06.20 20:53:20 5: portaal - No JSON Data received:
HTTP/1.1 200 OK
Cache-Control: no-cache, no-store, must-revalidate
Date: Sat, 20 Jun 2020 18:53:20 GMT
Pragma: no-cache
Server: Microsoft-IIS/10.0
Content-Length: 0
Expires: -1
Client-Date: Sat, 20 Jun 2020 18:53:20 GMT
Client-Peer: 171.25.178.37:443
Client-Response-Num: 1
Client-SSL-Cert-Issuer: /C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Domain Validation Secure Server CA
Client-SSL-Cert-Subject: /OU=Domain Control Validated/OU=COMODO SSL Wildcard/CN=*.sunnyportal.com
Client-SSL-Cipher: ECDHE-RSA-AES256-GCM-SHA384
Client-SSL-Socket-Class: IO::Socket::SSL
Set-Cookie: plantOid=3c013f0e-b46e-4449-882c-a0b2681b6f1e; path=/; secure; HttpOnly
X-AspNet-Version: 4.0.30319
X-AspNetMvc-Version: 5.2


2020.06.20 20:53:21 3: portaal - Cookie file deleted: ./log/portaal_cookie.txt
2020.06.20 20:53:21 4: portaal - Refresh - caller: SPG1.portaal, callerroom: SMAPortal, detail: "n.a.", pload: 0, forcePageRefresh: 0, event_Spgdev: 1


Code Auswählen Erweitern


Internals:
   CREDENTIALS Set
   FUUID      5eed2119-f33f-d772-e13b-7fc88af860916c3b
   FVERSION   76_SMAPortal.pm:v3.1.0-s22149/2020-06-09
   MODE       Automatic - next polltime: 21:03:52
   NAME       portaal
   NR         93
   STATE      ok
   TYPE       SMAPortal
   HELPER:
     ACTCYCLE   1
     CYCLEBTIME 1592679532
     GETTER     all
     PACKAGE    FHEM::SMAPortal
     RETRIES    1
     SETTER     none
     SPGDETAIL
     SPGDEV     SPG1.portaal
     SPGROOM    SMAPortal
     VERSION    3.1.0
     oldlogintime 1592679538
   READINGS:
     2020-06-20 20:58:52   dailyCallCounter 20:139
     2020-06-20 20:58:58   dailyIssueCookieCounter 20:139
     2020-06-20 20:58:58   loginState      successful
     2020-06-20 20:58:58   state           ok
Attributes:
   providerLevel balanceDayData,consumerCurrentdata,consumerDayData,consumerMonthData,consumerYearData,forecastData,liveData,weatherData,plantLogbook
   room       SMAPortal
   verbose    5
   verbose5Data consumerMasterdata,plantData


[DS_Starter]

Looks like no error...

Not really, you got no data from SMA Portal:

2020.06.20 20:48:08 4: portaal - Getting plantMasterData
2020.06.20 20:48:08 5: portaal - No JSON Data received:
...

Is your Asset registered at the SMA Portal ?
And what do you get if you login to the SMA Portal with a Firefox Browser and enter that page after successful login ?

https://www.sunnyportal.com/HoMan/Forecast/LoadRecommendationData

You must get JSON data like that in the screeshot.

[kroonen]

Hi,

When I login I see in the portal my pv systemoverview (see screenshot0

What else do I need to register the asset?

the url https://www.sunnyportal.com/HoMan/Forecast/LoadRecommendationData

I get an empty page

[DS_Starter]

When I login I see in the portal my pv systemoverview (see screenshot0

What else do I need to register the asset?

That's fine, nothing more to do.

But

the url https://www.sunnyportal.com/HoMan/Forecast/LoadRecommendationData

I get an empty page

is a / the problem. You get no data. May be your used user has not enough rights ?
Have a look at the screenshot of my plant. I have much more Information and I am able to configure my assets.

[kroonen]

I think also the that is the problem.

I go ask my installer of the solar panels for the administrator right.

I let you know when I have that rights

[DS_Starter]

Morgen könnte es Login Probleme geben:

Am 22.06.2020 zwischen ca. 09:30 Uhr und 10:30 Uhr (MESZ) werden Wartungsarbeiten an Sunny Portal durchgeführt.
Registrierungen von neuen Anlagen sind in diesem Zeitraum nicht möglich.
Wir bitten um Verständnis.

Nur damit ihr das schonmal wisst. 

Grüße,
Heiko